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ABSTRACT 


Pilot  performance  in  a  flight  simulator  was  objectively 
measured  with  30  Air  Force  jet  qualified  pilots  using  stan¬ 
dard  and  vertical  reading  primary  flight  instruments*  During 
the  completion  of  a  simulated  mission  profile,  five  flight 
parameters  were  selectively  campled  and  scored:  heading, 
altitude,  mach,  vertical  rate,  and  airspeed* 

Comparing  the  standard  and  vertical  instruments,  the 
following  results  wore  obtained: 

1*  Heading  performance  with  the  standard  reading  side 
instruments  was  superior  to  the  vertical  instruments. 

2*  Altitude  performance  was  found  to  be  significantly 
better  with  the  standard  reading  instrument* 

3*  Mach  performance  was  significantly  better  with  the 
vertical  reading  instrument, 

lu  Vertical  rate  performance  indicated  no  significant 
differences  between  standard  and  vertical  reading 
instruments* 

5*  Airspeed  performance  indicated  no  significant 
difference  between  star,  r-1  and  vertical  reading 
instruments* 


iii 


TABLE  OP  CONTENTS 


Section 

I.  SUMMARY  AND  CONCLUSIONS 
H.  INTRODUCTION 

1*  Back,.  i  of  Instrument  Development 
2.  Instr  ;':t  Display  Investigations 
3*  Objectives  of  the  Present  Study 


III*  EXPERIMENTAL  METHOD  10 

1*  Apparatus  10 

2*  Subjects  13 

3*  Subject's  Task  16 

li«  Scoring  Equipment  18 

5.  Experimental  Procedure  21 

I?.  RESULTS  22 

1.  Heading  Control  22 

2*  Altitude  Control  25 

3«  Mach  Control  27 

iu  Vertical  Rate  Control  29 

5.  Airspeed  Control  31 

6.  Individual  Maneuver  by  Flight  Parameter  Analysis  32 

7*  Experienced  vs  Non-experlencei  Performance  36 

on  Vertical  Reading  Instruments 
8.  Altimeter  Reading  Errors  37 

V*  DISCUSSION  OP  RESULTS  38 

1*  Why  Vertical  Instruments  38 

2*  Interpretation  of  Findings  39 


Page 

1 

3 

3 

6 


VI*  REFERENCES 


la 


VII.  TECHNICAL  AFFENDICES 

A.  Flight  Instructions 
B*  Scoring  Sheet 

C.  Scoring  Procedures 

D.  Cockpit  Oheck  and  Practice  Session 
E*  Mean  RMS  Errors  by  Maneuvers  for 

Experienced,  Non -experienced,  and 
all  Subjects  on  Standard  and  Vertical 
Reading  Instrument  Performance 


hh 

h$ 

he 

h9 

52 

56 


iv 


I 


LIST  OF  ILLUSTRATIONS 


Figure 

hsi 

1 

Modified  Air  Force  Phase  II  Integrated 

Instrument  Panel  Installed  in  YF-102  Simulator 

12 

2 

Modified  Standard  Reading  Instrument 

Panel  Installed  in  YF-102  Simulator 

lh 

3 

Flight  Task 

17 

h 

Experimenter's  Scoring  Panel 

19 

r 


> 

%  #  • 

LIST  OF  TABI£S 


Table  Page 

1  Subject  Experience  Data.  1$ 

2  Flight  Parameters  Scored  During  .Each  Maneuver  21 

of  the  Flight  Task. 

3  Analysis  of  Variance  Results  for  Heading  Performance  23 

with  Standard  Versus  Vertical  Heading  Side  Flight 
Instruments  for  all  Subjects.  N »30. 

A  Analysis  of  Variance  Results  for  Heading  Performance  2k 

with  Standard  Versus  Vertical  Reading  Side  Flight 
Instruments  for  13  Subjects  with  Vertical  Instrument 
Experience. 

5  Analysis  of  Variance  Results  for  Heading  Performance  2h 

with  Standard  Versus  Vertical  Reading  Side  Flight 
Instruments  for  17  Subjects  with  no  Vertical  Instru¬ 
ment  Experience. 

6  Analysis  of  Variance  Results  for  Altitude  Performance  2$ 

on  Standard  Versus  Vertical  Reading  Flight  Instruments 

for  all  Subjects.  N-30. 

7.  Analysis  of  Variance  Results  for  Altitude  Performance  26 

on  Standard  Versus  Vertical  Reading  Flight  Instruments 
for  13  Subjects  with  Vertical  Instrument  Experience. 

8  Analysis  of  Variance  Results  for  Altitude  Performance  26 

on  Standard  Versus  Vertical  Reading  Flight  Instruments 

for  17  Subjects  tdth  no  Vertical  Instrument  Experience. 

9  Analysis  of  Var^nce  Results  for  Mach  Performance  on  27 

Standard  Versus  Vertical  Reading  Flight  Instruments 

for  all  Subjects.  K»30. 

10  Analysis  of  Variance  Results  for  Mach  Performance  on  28 

Standard  Versus  Vertical  Reading  Flight  Instruments 

for  13  Subjects  with  Vertical  Instrument  Experience* 

11  Analysis  of  Variance  Results  for  Mach  Performance  on  28 

Standard  Versus  Vertical  Reading  Flight  Instruments 

for  17  Subjects  with  no  Vertical  Instrument  Experience. 


Tl 


Table 


P*fg 

12  Analysis  of  Variance  Results  for  Vertical  Kate  29 

Performance  on  Standard  Versus  Vertical  Reading 

Flight  Instruments  for  all  Subjects*  N»30. 

13  Analysis  of  Variance  Results  for  Vertical  Rate  30 

Performance  on  Standard  Versus  Vertical  Reading 

Flight  Instruments  for  13  Subjects  with  Vertical 
Instrument  Experience* 

U4  Analysis  of  Variance  Results  for  Vertical  Rate  30 

Performance  an  Standard  Versus  Vertical  Reading 
Flight  Instruments  for  1?  Subjects  with  no 
Vertical  Instrument  Experience* 

15  Results  of  t  Tests  on  Differences  in  Mean  Airspeed  31 

RMS  Error  on  Standard  and  Vertical  Reading  Flight 
Instruments* 

16  Results  of  t  Tests  on  Differences  in  Mean  Heading  33 

RMS  Errors  with  Standard  and  Vertical  Reading  Side 

Flight  Instruments  for  all  Subjects*  H»30. 

17  Results  of  t  Tests  on  Differences  in  Mean  Altitude  3U 

RMS  Errors  on  Standard  and  Vertical  Reading  Flight 
Instruments  for  all  Subjects*  N-30* 

18  Results  of  t_Tests  on  Differences  in  Mean  Mach  RMS  3£ 

Errors  on  Standard  and  Vertical  Reading  Flight 
Instruments  for  all  Subjects*  N"30* 

19  Results  of  t  Tests  on  Differences  in  Mean  Vertical 
Rate  RMS  Errors  on  Standard  and  Vertical  Reading 
Flight  Instruments  for  all  Subjects*  N«30* 

20  Results  of  t  Tests  on  Differences  in  Mean  Heading  36 

Performance  with  the  Vertical  Reading  Side  Instruments 

for  the  Experienced  and  Non~Experienced  Subjects  Who 
Performed  on  the  Vertical  Reading  Instruments  First* 

21  Results  of  t  Test  on  Differences  in  Kean  Performance  37 

on  the  Vertical  Reading  Altimeter  for  the  Experienced 

and  Non-Kxperienced  Subjects  Who  Performed  on  the 
Vertical  Reading  Instruments  First* 


vii 


22 


Mean  Heading  RMS  Errors 


% 


i 


Table 

2*ss. 

23 

Mean  Altitude  RMS  Errors. 

56 

2lt 

Kean  Mach  RMS  Errors. 

57 

2$ 

Kean  Vertical  Rate  RMS  Errors. 

57 

26 

Kean  Airspeed  RMS  Errors. 

57 

Till 


I 


I 


SUMMARY  AND  CONCLUSIONS 


The  past  ten  years  have  seen  a  radical,  shift  in  the  basic 
principles  of  the  display  of  flight  info  its  l  ion.  For  the  first 
tine,  integrated  flight  instrument  panels  are  being  developed 
in  toxins  of  the  whole  panel  instead  of  piecemeal  by  single  in¬ 
struments  (sea  Wright^  1956).  One  of  the  immediate  results  of 
whole  panel  development  has  been  the  use  of  new  instrument  types. 
The  most  singular  example  of  this  has  been  the  shift  from  cir¬ 
cular  scales  to  straight  scales.  However,  these  changes  have 
been  of  such  fundamental  magnitude  that  concern  nas  been  ex¬ 
pressed  over  the  capability  cf  the  pilot  to  perform  proficiently 
on  the  new  display  systems.  Coincident  with  the  development  of 
the  whole  panel  technique  has  come  a  new  sophistication  about 
the  methodology  of  test  and  evaluation  of  pilot-instrument  sys¬ 
tems.  Previous  methods  evaluated  performance  on  just  or c  type 
of  or  a  single  instrument,  usually  stressing  "good"  performance 
on  that  particular  instrument  not  recognising  the  possibility 
of  performance  degradation  on  other  related  flight  parameters. 

In  reality,  the  pilot's  task  involves  a  time-sampling  process 
•cross  several  instruments  displaying  many  different  flight 
parameters,  and  the  objective  measurement  of  pilot  performance 
should  take  this  fact  into  account. 

The  primary  purpose  of  this  study  is  to  demonstrate  objec¬ 
tive  measurement  of  pilot  simulator  performance  in  the  wholo 
panel  context  where  several  flight  parameters  are  selected  and 
scored  simultaneously.  A  second  objective  of  this  study  is  to 
objectively  measure  pilot  simulator  performance  on  several  flight 
parameters  while  using  either  standard  circular  flight  instru¬ 
ments  or  straight  scale  vertical  reading  instruments  to  fly  a 
simulated  complex  flight  profile. 

A  standardized  fli^it  profile  was  flown  by  30  Air  Force 
jet  qualified  pilots  in  a  YF-102  Link  flight  simulator  using 
two  instrument  panel  configurations.  One  display  system  util¬ 
ised  the  vertical  reading  scales  of  the  USAF  Phase  II  Inte¬ 
grated  Instrument  Panel,  and  the  other  used  the  circular  scales 
of  the  standard  reading  flight  instruments  most  common  in  air¬ 
craft  today.  Pilot  performance  on  heading,  altitude,  mach, 
vertical  rate,  and  airspeed  control  was  measured  by  means  of 
electronic  scoring  equipment  which  provided  an  error  tena  that 
was  reduced  to  a  root-mean- square  (RMS)  score.  The  data  were 
subjected  to  thorough  statistical  analysis. 

Results  indicated  that  (1)  heading  performance  with  the 
standard  reading  side  instruments  was  superior  to  that  with 
the  vertical  reading  side  instruments,  (2)  performance  on  the 


standard  reading  altimeter  was  superior  to  performance  on  the 
vertical  reading  altimeter,  (3)  mach  performance  was  superior 
on  the  vertical  reading  mach  indicator,  and  ub)  vertical  rate 
and  airereed  performance  shoved  no  differences  between  instru¬ 
ment  configurations.  Separate  analyses  for  those  subjects  with 
end  without  previous  vertical  instrument  experience  did  not 
alter  these  findings. 

In  essence,  performance  on  the  vertical  reading  instruments 
for  mach,  vertical  rate,  and  airspeed  was  found  to  be  equivalent 
to  or  hotter  than  performance  on  the  standard  reading  instru¬ 
ments  for  the  same  flight  parameters.  Consequently,  it  may  be 
concluded  that  no  degradation  in  performance  would  be  expected 
on  a  shift  from  standard  to  vertical  reading  instruments  for 
the  flight  parameters  of  mach,  vertical  rate,  and  airspeed  with 
scale  factors  comparable  to  those  used  in  this  study.  Such  a 
sliift  would  then  allow  for  satisfactory  addition  of  command  in¬ 
formation  markers  and  reduce- the  scale  length  limitations  exist¬ 
ent  on  circular  dials.  Altimeter  performance  results  suggest 
that  further  experimentation  is  required  to  produce  a  vertical 
moving-tape  scale  that  will  promote  performance  at  least  equiva¬ 
lent  to  that  on  the  standard  reading  instrument.  Suggested  ex¬ 
perimental  scalar  designs  for  non-linear  scales,  combination  of 
non-linear  scales,  combination  of  linear  and  non-linear  scales, 
and  combination  of  linear  scales  are  nearing  the  human  factors 
evaluation  stage. ,  Because  heading  performance  was  measured  on 
the  same  indicator  v.th  different  side  instruments,  no  direct 
performance  comparison  was  possible.  However,  interpretation 
of  the  results  indicatos  that  prior  experience  with  vertical 
reading  instruments  soemstu  allow  more  time  for  heading  moni¬ 
toring  aside  from  primary  pitch  control  under  the  conditions 
of  this  experiment. 

The  need  for  further  human  factors  research  in  the  area 
of  fli^vfc  information  display  techniques  is  most  urgent.  The 
early  Mfcg-flyingw  daye  of  Doolittle* s  time  are  gone;  today's 
ultra-high  performance  aircraft  require  precision  flight  con¬ 
trol  over  fantastically  expanded  flight  envelopes,  and  there 
is  every  reason  to  assume  that  the  aircraft  and  space  vehiclos 
of  tomorrow  may  make  even  more  extreme  demands  on  the  pilot. 

The  development  of  optimum  displays  both  from  the  standpoint 
of  the  man  and  the  mechanism  is  imperative.  Zt  is  probable  that 
the  success  of  such  a  development  program  will  rest  upon  the 
use  of  sophisticated  objective  measuring  techniques  in  every 
step  of  development  from  initial  instrument  design,  through 
flight  simulator  research,  and  most  important  of  all  in  inflight 
test  and  evaluation. 


INTRODUCTION 


Background  of  Instrument  Development 


Man  has  been  engaged  in  the  developnent  of  airborne  equips 
ment  for  the  measurement  and  display  of  flight  information  since 
the  very  beginning  of  manned  flight.  Nicklas  (1958)  has  noted 
that: 

"The  history  of  aeronautical  instruments  began  a  few  years 
after  the  invention  of  the  free  balloon  in  1783*  At  this 
time,  the  mercurial  barometer  vas  adopted  for  measuring 
altitudes.  In  13^5,  the  aneroid  barometer  replaced  the 
mercurial  type  because  of  its  lighter  weirfit  and  greater 
convenience,  even  though  it  vas  less  accurate.  Sometime 
later,  the  aneroid  vas  scaled  in  feet  of  pressure  altitude 
replacing  the  inches  of  mercury  scale." 

Since  man  was  ascending  towards  the  heavens,  it  would  appear 
only  natural  that  he  would  be  interested  in  knowing  how  high 
he  had  risen.  The  horizontal  distance  traveled  was  also  im¬ 
portant,  and  as  Nicklas  (1958)  points  out,  the  Hright  Brothers 
used  a  Richard  anemometer  to  measure  the  length  of  their  flights. 
In  later  years,  the  anemometer  vas  used  to  determine  airspeed* 
Initially,  however,  most  pilots  were  dependent  on  the  force  of 
the  wind  in  their  faces  to  judge  airspeed. 

Once  heavier- than-air  flying  machines  could  maintain  flight 
for  any  period  of  time,  pilots  began  seeking  devices  to  forewarn 
them  of  impending  malfunctions.  An  oil  pressure  gauge  and  a 
visible  fuel  line  were  the  first  to  appear.  As  manned  flight 
rose  to  greater  heights,  the  interest  in  instrumentation  turned 
to  indicating  straight  and  level  flight,  speed,  and  direction. 
Thus  began  man's  search  for  better  methods  of  displaying  the 
necessary  information  to  maintain  flight  first  under  contact 
conditions,  then  during  the  "fog-flying"  days,  and  more  re¬ 
cently  under  all-weather  conditions. 

Early  atteinpts  at  providing  infoimation  to  the  pilot  were 
hampered  by  the  inability  of  designers  and  builders  to  get  the 
indicator  in  the  cockpit.  Tho  instrumentation  was  placed  at  or 
ne~r  the  source  of  the  sensing  mechanism*  As  better  means  of 
transmitting  information  to  the  cockpit  were  devised,  the  num¬ 
ber  of  instruments  on  the  "board"  began  to  increase,  usually 
with  little  or  no  thought  as  to  how  necessary  or  how  often  the 
new  instruments  were  to  be  used. 


' 


Atterots  at  Instrument  and  Panel  Integration 


Hicklas  (1958)  points  out  that  instrument  integration,  the 
technique  of  displaying  several  pieces  of  related  flight  infor¬ 
mation  on  one  scale,  was  lacking,  in  the  early  ynars  of  aviation. 
However,  efforts  toward  panel  integration  were  made.  Doolittle 
naie  a  notable  contribution  in  this  direction  by  suggesting  that 
instruments  should  be  arranged  in  line  vertically  and  horizontal¬ 
ly  so  that  pointers  across  instruments  would  align  or  could  be 
adjusted  to  align  for  any  given  flight  condition.  By  so  doing, 
the  deviation  of  any  pointer  from  this  alignment  would  be  im¬ 
mediately  apparent  to  the  pilot  and  corrective  action  could  be 
taken.  Doolittle's  main  objective  was  simplification,  through 
which  he  sought  to  relieve  the  pilot  of  all  unnecessazy  inter¬ 
pretation* 


Hew  Whole  Panel  Concepts. 

Wright  (1956)  has  very  adequately  summarized  the  status  of 
flight  instrumentation  which  has  existed  since  shortly  after  the 
conclusion  of  World  War  n,  with  the  following  words: 

"When  the  situation  is  analyzed,  it  is  seen  that  there  ... 
(has  been)  •••  actually  no  systematic  method  for  design 
of  the  instrument  panel.  The  need  for  various  parameters 
to  control  flight  is  recognized  and  these  parameters  are 
measured  and  presented  with  some  type  of  display.  However, 
each  of  these  instruments  is  a  completely  independent,  un¬ 
related  entity,  often  conflicting  with  its  neighbor  on  the 
panel.  The  panel  as  a  whole  presents  the  pilot  with  a  lot 
of  unrelated  and  abstract  information.  He  must  continually 
scan  the  ever  changing  values  of  each  individual  instrument 
and  perform  a  continuous  series  of  mental  calculations  to 
convert  their  readings  into  usable  information  which  can 
be  used  for  the  control  of  the  aircraft. 

"Instruments  have  been  actually  becoming  a  limiting  factor 
in  the  capabilities  of  weapon  systems.  Specific  features 
tftlch  have  caused  trouble  are  the  excessive  number  of  in¬ 
struments,  more  than  could  actually  be  put  on  the  panel, 
their  small  sizes,  the  clutter  of  the  dials,  and  the 
cluttered  appearance  of  the  panel  in  general.  Various 
attempts  have  been  made  to  improve  the  situation,  by 
combining  one  or  more  instruments  into  one  case  and  re¬ 
ducing  the  size  of  the  instruments.  However,  none  of 
these,  have  been  really  successful  in  alleviating  the  un¬ 
satisfactory  conditions.  The  major  difficulty  has  been 


that  the  full  potential  has  been  realised  in  the  in¬ 
dividual  development  and  use  of  instruments,  and  a 
new  approach  is  required  to  provide  really  effective 
instrumentation  for  high  perfomance  aircraft *" 

The  need  for  a  new  concept  in  instrumentation  development 
was  becoming  increasingly  more  obvious.  The  "sacred  six"  or 
"eight"  arrangement  was  difficult  to  maintain  because  of  the 
large  numbers  of  instruments  "required"  on  the  panels,  the 
limited  space  available,  and  the  lack  of  an  overall  concept 
for  instrument  panel  arrangement  and  design.  The  instrument 
panel  could  no  longer  be  treated  with  the  attitude,  "it’s  got 
to  go  on  somewhere?'  Rather,  it  should  be  considered  as  a 
visual  communications  system,  with  information  presented  in 
a  related,  readable  and  interpretable  form  instead  of  as  in¬ 
dependent  bits  of  abstract  information.  Improvements  must  be 
pursued  on  a  "thole  panel"  basis  instead  of  on  an  individual 
instrument  basis. 

Wright  (1956)  speaks  of  the  "whole  panel"  concept  with  the 
following  words: 

"An  instrument  panel  designed  under  the  whole  panel  con¬ 
cept  is  one  designed  on  the  basis  of  the  total  visual 
communication  requirement,  wherein  each  individual  ele¬ 
ment  has  been  designed  in  terms  of  its  environment  and 
its  contribution  to  the  whole.  The  design  of  the  dis¬ 
play  of  each  individual  instrument  on  such  a  panel  is 
made  from  considerations  of  the  intelligence  that  it  is 
to  trarsmit  along  with  that  transmitted  by  all  other  in¬ 
struments  to  be  used  with  it,  the  display  of  this  intel¬ 
ligence  by  these  instruments,  and  the  way  these  instruments 
aie  arranged  in  relation  to  each  other.  It  is  the  philosphy 
of  the  design  of  the  individual  instruments  so  that  a  visual 
communications  system  will  result." 


Application  of  the  Whole  Panel  Concept 

The  concrete  application  of  the  whole  panel  concept  to 
the  design  of  integrated  instrument  panels  had  led  to  a  number 
of  major  changes  in  the  basic  principles  of  the  display  of  pri¬ 
mary  flight  information.  One  of  the  most  apparent  examples  of 
this  fact  is  the  shift  from  circular  dials  to  straight  scales) 
the  USAF  Phase  11  Panel  (Svimonoff,  1958)  is  a  specific  illu¬ 
stration  of  the  extensive  uss  of  vertical  straight  scales  in 
place  of  circular  dials. 


-5- 


2h  actual  fact,  atraigit  scales  had  been  used  early  in 
the  history  of  flight  instrument  development  in  at  least  one 
specific  case.  Nicklas  (1958)  reports  that  during  the  period 
of  1923-l?2b,  the  D.  H.  airplane  P-302  appeared  with  an  in¬ 
strument  board  that  included  vertical  scale  instruments  for 
pitch,  airspeed,  RPM,  and  engine  gauges.  The  Pioneer  Flight 
Indicator,  which  gave  the  pilot  a  more  direct  indication  of 
pitch  attitude,  variation  from  being  level  in  bank,  and  cor¬ 
rect  rudder-aileron  application,  represents  one  of  the  earlier 
instances  of  combining  several  instruments  within  a  single 
ease.  In  1 925,  the  Pioneer  instrument  board  appeared  with  a 
vertical  scale  rate  of  climb  instrument  added  to  the  previous 
array  of  vertical  scale  instruments.  In  general,  from  the 
midtwenties  to  the  midthirties,  a  number  of  vertical  scale 
instruments  appeared.  Then  followed  a  reversion  to  the  cir¬ 
cular  scales  which  lasted  until  the  midfifties  when  the  pre¬ 
sent  return  trend  to  the  vertical  scales  was  initiated. 

However,  a  change  in  display  design  concept  must  assume 
that  the  pilot  is  able  to  use  the  new  instrument  technique 
more  effectively  than  the  previous  method.  To  demonstrate 
that  this  is  in  fact  the  case,  there  are  a  number  of  evalu¬ 
ation  techniques  possible.  One  line  of  evaluation  is  experi¬ 
mental  investigation  from  the  human  factors  point  of  view. 

This  type  of  evaluation  may  be  illustrated  by  examples  of 
instrument  display. investigations  and  particularly  the  study 
of  altimeter  displays. 


Instrument  Display  Investigations 


Static  Studies  of  Altimeter  Displaj 


As  Muckier  (1959)  points  out,  "The  development  of  altimeter 
display  techniques  ...  was  not  based,  for  the  first  thirty  years 
at  least,  on  experimental  investigations  of  optimum  display  prin¬ 
ciples  from  the  pilot's  point  of  view.  Like  most  cockpit  instru¬ 
ments,  the  display  techniques  were  usually  selected  on  the  basis 
of  individual  judgment  and  modified  on  the  basis  of  field  exper¬ 
ience '*•  It  be can?  evident  by  the  late  19h0's,  that  the  display 
of  altitude  information  was  not  optimum  from  the  pilot's  point 
of  view  and  the  need  for  investigation  to  provide  inprovements 
was  increasingly  obvious. 


Orether  (19l*7)  was  the  first  to  investigate  experimentally 
the  presentation  o 1  altitude  information.  He  compared  a  variety 


of  altimeter  configurations  by  a  paper  end  pencil  technique 
from  which  he  recorded  errors  of  interpretation  as  well  as 
interpretation  time.  The  displays  included  the  conventional 
three-pointer  altimeter,  combinations  of  a  counter  and  a 
pointer,  a  counter  alone,  and  also  two  configurations  of  moving- 
tape  vertical  displays*  After  considering  the  various  uses  of 
altitude  information,  he  recommended  a  combination  of  a  sensi¬ 
tive  pointer  and  counter  as  offering  the  most  promise*  The 
vertical  displays  compared  quite  favorably  with  the  counter¬ 
pointer  displays  under  his  experimental  conditions,  and  were 
much  superior  to  the  standard  three-pointer  altimeter* 

The  Simon  studies  (Simon,  et.al.,  1956;  Simon  and  Roscoe, 
1?56)  report  several  investigations  of  altitude  information 
display  techniques*  These  studies  also  used  a  paper  and  pencil 
technique  in  which  the  pilot  subjects  were  required  to  meJce 
flight  decisions  on  the  basis  of  information  that  was  present¬ 
ed  on  drawings  of  the  various  displays*  In  general,  their  find¬ 
ings  indicated  that  performance  was  superior  on  the  integrated 
vertical  linear-scale  display  over  several  methods  of  circular 
display*  No  change  in  the  results  was  recorded  between  two  levels 
of  pilot  experience  among  the  subject  groups. 


Use  of  Flight  Simulators  for  Objective  Measurement 


Early  investigations  of  information  presentation  to  the 
pilot  were  limited  to  static  legibility  tests.  Little  had  been 
done  to  conpare  pilot  performance  in  the  simulated  inflight  sit¬ 
uation  where  the  Instruments  are  used  as  a  contin'ious  tracking 
display.  Recently,  however,  Mengelkoch  and  Houston  (1958a,  1958b, 
1958c)  have  published  three  studies  investigating  pilot  perfor¬ 
mance  with  various  altimeter  displays  while  flying  a  profile  in 
a  Link  C-8  Instrument  Train*.'. 

In  the  first  study  (1958a),  twenty  experienced  instrument 
qualified  pilots  flew  a  series  of  maneuvers  in  the  trainer  using 
the  standard  three-pointer  altimeter  and  an  experimental  vertical 
moving-tape  linear  scale  altimeter.  Performance  on  the  three- 
pointer  altimeter  was  found  to  be  superior  to  performance  on  the 
moving-tape  altimeter,  although  the  magnitude  of  the  performance 
differences  was  small*  The  authors  considered  the  differences 
not  to  be  operationally  significant* 

In  the  second  stuty  (1958b),  11*  pilots  from  the  group  used 
in  the  first  stuoy  wore  given  additional  practice  on  the  vertical 
moving-tape  altimeter*  The  results  again  indicated  Jiat  perfor¬ 
mance  on  the  tliree -pointer  altimeter  was  superior  to  performance 


on  the  vertical  moving-tape  altimeter*  Performance  on  both 
altimeters  was  increased,  but  the  difference  in  performance 
between  displays  remained  approximately  the  same*  It  was 
concluded  that  further  additional  practice  would  not  serve 
to  reduce  the  difference  in  performance,  and  that  the  effects 
of  an  expanded  scale  should  be  investigated* 

The  third  stuty  (1558c)  was  designed  to  determine  the 
effects  on  performance  of  an  expanded  scalo  on  tho  moving-tape 
display  when  compared  to  performance  on  the  standard  three- 
pointer  altimeter*  The  scale  was  expanded  from  1*5  inches  per 
thousand  feet  (used  in  the  first  two  studies)  to  2*375  inches 
per  thousand  feet*  Two  groups  of  experienced  instrument  qual¬ 
ified  pilots  (10  from  the  original  group  and  12  with  no  pre¬ 
vious  experience  on  vertical  reading  instruments)  flew  the 
same  simulated  flight  maneuvers  used  in  the  earlier  studies 
on  each  altimeter  display*  The  results  showed  that  perfor¬ 
mance  cn  the  vertical  reading  moving-tape  altimeter  with  a 
scale  factor  of  2*375’*  per  1000*  was  essentially  equivalent 
to  performance  on  the  three-pointer  altimeter*  The  need  for 
further  evaluation  in  a  high  performance  jet  simulator  was 
expressed* 

Muckier  (195?)  comments  on  the  work  of  Mengelkoch  and 
Houston,  stating  that  "The  results  of  this  series  of  studies 
would  not  have  been  predicted  on  the  basis  of  the  static  leg¬ 
ibility  investigations  •••  (previously  mentioned)*  However, 
the  final  experiment  ***  (Mengelkoch  and  Houston,  1958c)*. * 
would  seem  to  indicate  that  superiority  of  instrument  type 
in  the  tracking  situation  is  a  matter  of  detailed  scalar 
design  and  not  of  basic  instrument  type"* 


Objectives  of  the  Present  Study 


Past  experimental  investigations  have  usually  dealt  with 
just  one  type  of  instrument  --  measuring  performance  in  some 
fashion  on  a  single  flight  parameter*  In  reality,  the  pilot 
"flys"  several  instruments  at  one  tine*  His  task  is  complex, 
requiring  the  interpretation  and  integration  of  information 
from  many  sources*  Consequently,  pilot  performance  measurement 
should  take  into  account  tho  entire  informational  context  and 
sample  performance  from  the  whole  panel  concept* 

The  present  study  is  offered  as  an  example  of  a  methodology 
for  accomplishing  this  basic  need  in  present-day  man-machine 
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performance  measurement  and  evaluation.  It  is  not  intended  to 
replace  the  methods  previously  discussed,  but  is  rather  an  ex¬ 
tension  in  a  more  sophisticated  manner  to  the  uhole  panel  context. 

Specifically,  the  present  study  eas  da  signed  to  accomplish 
three  objectives: 

1.  To  measure  pilot  performance  simultaneously  on  several 
flight  parameters  on  a  simulated  flight  task. 

2.  To  compare  pilot  performance  measures  on  two  different 
display  principles:  Standard  reading  round  dial  displays 
and  vertical  reading  moving-tape  displays. 

3.  To  provide  a  standardized  technique  for  the  evaluation 
of  pilot  performance  under  varying  simulated  flight 
conditions  of  instrumentation,  dress,  and  environment. 


EXPERIMENTAL  METHOD 


Apparatus 


IP-102  Flight  Simulator. 

The  XF-102  Link  flight  simulator,  located  in  the  Instru¬ 
mentation  Research  Section,  Flight  Control  Laboratory,  Wright 
Air  Development  Center,  Dayton,  Ohio,  va3  used  as  the  experi¬ 
mental  apparatus*  This  simulator  is  an  electronic  analog  com¬ 
puter  t&ich  was  designed  to  solve  the  flight  equations  of  the 
XF-102  aircraft*  For  purposes  of  this  study,  the  flight  equa¬ 
tions  were  altered  to  produce  a  highly  sensitive,  moderately 
high  performance  flight  simulator  representative  of  no  parti¬ 
cular  present  day  aircraft*  The  simulator  vas  capable  of  speeds 
up  to  mach  1*2,  altitudes  up  to  50,000  feet,  and  vertical  speeds 
up  to  U0,000  feot  per  minute*  Flight  simulation  is  presented  by 
continuously  changing  flight  display  indications  in  response  to 
pilot  control  actions*  The  simulator  does  not  have  motioh. 

■v  Instrument  conditions  vere  simulated  by  covering  the  can¬ 

opy  and  windscreen  with  grey  paper*  The  canopy  was  closed  for 
each  flight*  The  instrument  panel  was  lighted  by  a  fluorescent 
lamp  located  in  the  top  of  the  canopy  in  such  a  manner  so  as  to 
give  good  lighting  over  the  entire  panel  and  forward  half  of  the 
cockpit.  The  cockpit  was  air  conditioned  for  the  subjects1  com¬ 
fort*  An  intercom  system  was  used  that  provided  clear  communi¬ 
cations  between  the  experimenter  and  the  subject* 

A  full  set  of  repeater  instruments  was  available  to  the 
experimenter  for  monitoring  performance  and  to  provide  the  pro¬ 
per  cues  to  commence  scoring  at  various  places  in  the  profile* 

In  addition,  a  "freeze”  or  hold  switch  was  available  which  made 
it  possible  to  freeze  the  simulator  in  any  flight  condition* 


Flight  Instrumentation* 

Two  instrument  configurations  were  used*  One  consisted 
essentially  of  vertical  reading,  moving-tape,  primary  flight 
instruments  and  the  other  of  standard  reading  round  primary 
flight  instruments* 

Vortical  Reading  Instruments,  The  vertical  reading  panel 
made  use  of  the  Air  Force  thase  ll  Integrated  Instruments 
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(Svimonoff,  1958,  p.x)  and  is  shown  in  Figure  1*  However, 
only  selected  features  of  these  instruments  were  utilised* 

Hie  following  modifications  were  made  to  produce  the  desired 
effect! 

1*  The  Attitude  Director  Indicator  was  usee  to  present 
only  pitch  and  bank  information*  The  glide  slope 
displacement  pointer,  bank  director  needle,  and  pitch 
director  needle  were  not  operative*  Essentially,  it 
operated  as  a  conventional  attitude  instrument  with 
additional  features  such  as  a  two-tone  sphere  with 
pitch  degree  and  ground  reference  markings  on  a  five 
inch  display* 

2*  The  Horizontal  Situation  Indicator  was  used  to  present 
only  heading  information*  It  is  a  five  inch  instru¬ 
ment  which  employs  a  moving  card  with  a  stationary 
index  to  display  heading  information*  The  bearing 
pointer,  command  heading,  course  arrow  and  deviation 
bar,  to-from  indicator,  and  mode  windows  were  inoper¬ 
ative*  The  digital  readouts  for  course  and  distance 
were  masked  off,  and  the  subject  was  instructed  not 
to  operate  the  Course  Select  Knob  or  the  Manual 
Select  Knob  for  command  heading* 

3*  The  airspeed-mach  indicator  had  the  angle  of  attack 
tape  and  the  digital  readouts  for  command  mach  and 
airspeed  masked  off*  The  command  markers  for  both 
mach  and  airspeed  were  slewed  to  the  extreme  top  of 
the  instrument  and  remained  there  during  the  entire 
flight*  Subjects  ware  instructed  not  to  operate  the 
command  marker  slowing  switches*  The  airspeed  moving 
tape  was  numbered  at  50  knot  intervals  with  markings 
for  every  10  knots  of  airspeed*  The  mach  moving  tape 
waa  numbered  at  every  *1  mach  with  markings  for  every 
*01  roach* 

lu  The  altitude-rate  of  climb  indicator  had  the  vertical 
planning  scale,  target  altitude  digital  readout,  and 
the  command  altitude  digital  readout  masked  off*  The 
altitude  command  marker  was  slewed  to  the  extreme  bottom 
of  the  scale  and  remained  there  for  tne  entire  flight* 
Barometric  setting  was  placed  at  29*92*  Subjects  were 
instructed  not  to  operate  the  command  marker  slewing 
switch  or  the  barometric  set  knob.  The  altimeter  moving 
tape  was  numbered  at  every  1000  foot  level  with  small 
markings  for  every  100  feet  and  a  somewhat  larger  mark¬ 
ing  for  the  500  foot  levels*  The  rate  of  climb  pre¬ 
sentation  was  not  altered*  This  instrument  is  capable 
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legend 

1*  Fuel  flow  gauge 
2*  Fuel  quantity  gauge 
3*  Tailpipe  temperature  gauge 
b.  Percent  RPM  gauge 
5«  Landing  gear  indicator 
6*  Vertical  reading  airspeed-mach  indicator 
a*  Mach  scale 
b.  Airspeed  scale 

7.  Attitude  Director  Indicator 

8.  Horizontal  Situation  Indicator 

9#  Vertical  reading  altimeter-rate  of  climb  indicator 
a.  Rate  of  climb  scale 
b«  Altimeter  scale 
10*  Station  marker  light 
11.  Turn  and  bank  indicator 
•12*  Penetration  placard 
13*  Speed  brake  indicator 


Figure  1*  Modified  Air  Force  Phase  II  Integrated  Instrument  Panel 
Installed  in  YF-102  Simulator. 


of  displaying  vertical  rate  changes  up  to  1*0,000  feet 
per  minute,  and  is  near  instantaneous  in  its  presenta¬ 
tion* 


Standard  Reading  Instruments.  The  standard  reading  panel, 
shown  in  Figure  2,  utilized  the  Attitude  Director  Indicator  and 
the  Horizontal  Situation  Indicator  previously  mentioned* 

The  ME-1  round  type  airspeed-mach  indicator  was  used  in 
place  of  tho  vertical  reading  instrument*  This  instrument  uses 
a  single  moving  pointer  against  a  stationary  airspeed  scale  and 
a  rotating  mach  scale*  The  set  index  mark  was  placed  at  the 
low  end  of  the  scale  and  the  subjects  were  instructed  not  to 
adjust  the  knob.  The  instrument  was  mounted  in  a  face  plate 
fitted  to  cover  the  hole  used  to  mount  the  vertical  reading 
airspeed-mach  instrument* 

The  vertical  reading  altimeter-rate  of  -limb  instrument 
was  replaced  by  separate  round  type  altitude  and  rate  of  climb 
instruments*  A  three-pointer  altimeter  (HA-1)  without  low  al¬ 
titude  cross  hatch  wanting  was  utilized*  Barometric  setting 
was  set  at  29*92  and  subjects  were  instructed  not  to  adjust 
the  setting  knob.  The  conventional  6,000  feet-per-ninute  rate 
of  climb  instrument  (MS  2301*9-1)  was  used*  This  instrument 
has  a  7-12  second  lag  in  its  presentation*  Both  instruments 
ware  mounted  in  a  face  plate  fitted  to  cover  the  hole  used  to 
mount  the  vertical  reading  altimeter-rate  of  climb  instrument* 

Additional  Common  Instrumentation.  Several  instruments 
and  indicators  were 'common  to  both  panel  configurations*  They 
were  the  percent  KPM  gauge,  speed  brake  indicator,  landing  gear 
indicator,  and  station  marker  light  (used  to  show  passage  of 
the  high  and  low  stations)*  A  turn  and  bank  indicator,  tail 
pipe  temperature  gauge,  and  fuel  flow  gauge  were  also  visible, 
hut  monitoring  of  these  instruments  was  not  required  during 
any  part  of  the  flight  profile* 


Subjects 


Because  of  the  nature  of  the  experimental  task  and  the 
variables  being  investigated,  it  was  determined  that  the  sub- 
jaot  population  should  be  highly  trained  experienced  pilots 
qualified  in  jet  aircraft*  Accordingly,  the  following  minimum 
requirements  were  set  up:  (1)  Air  Force  jet  qualified  pilot, 
(2)  must  have  had  at  least  $0  hours  in  the  last  six  months,  and 
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legend 

it  Fuel  flow  gauge 
2d  Fuel  quantity  gauge 
3#  Tailpipe  temperature  gauge 
lit  Percent  RIM  gaugo 
5*  Landing  gear  indicator 
6t  MS-1  airapeed-mach  indicator 
7#  Attitude  Director  Indicator 
8.  Horizontal  Situation  Indicator 
Ft  HA-1  standard  reading  altimeter 
10*  MS  2801*9-1  standard  rate  of  climb  indicator 
Ut  Statical  marker  light 
12*  Turn  and  bank  indicator 
13t  Penetration  placard 
lilt  Speed  brake  indicator 


Figure  2t  Modified  Standard  Reading  Instrument  Panel 
Installed  in  IF-102  Simulator. 
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18.9  370.2  1552*7  217.8  1|003.7 


(3)  must  be  instnmsnt  qualified*  Thirty  Air  Force  pilots 
stationed  at  Wlright-Patterson  Air  Force  Base  were  used  as 
subjects*  All  participation  was  voluntary*  Subjects  were 
given  Form  5  credit  for  two  hours  of  jet  simulator  time* 

The  flight  qualifications  of  the  subjects  are  shown  in 
Table  1* 

Sixteen  of  the  subjects  were  attached  to  Fighter  Branch* 
Directorate  of  Flight  and  All-Weather  Test*  Wright  Air  Develop¬ 
ment  Center  and  the  remaining  fourteen  were  recruited  from  other 
sources  on  the  base*  As  Table  1  shows*  the  subjects  varied  in 
rank  from  l/Lt*  to  Colonel*  had  a  mean  age  of  3h  years*  all  had 
instrument  cards*  13  had  previous  vertical  instrument  experience 
ranging  from  1  to  56  hours  with  a  mean  of  10*8  hours*  had  a  mean 
of  18*9  hours  of  jet  simulator  time*  had  a  mean  of  370*2  hours 
„  of  instrument  time,  had  a  mean  -of  1552*7  hours  of  jet  time*  had 
a  mean  of  117*8  hours  in  the  last  six  months*  and  had  a  mean  of 
1*003*7  hours  total  time* 

Eight  p re -experimental  subjects  were  used  to  evaluate  the 
flight  task  and  the  scoring  system*  and  to  provide  practice  for 
the  experiment er* 


Subjects  Task 


A  flight  task  was  designed  to  encompass  many  of  the  common 
flight  procedures-  that  are  typical  of  military  jet  aircraft 
flights*  The  flight  task*  shown  in  Figure  3*  involves  the  fol¬ 
lowing  maneuvers  i  Take-off  and  climb  to  1*0,000  feet  at  mach  *85 
(15*000-20,000  fpm),  level  off  at  1*0,000  feet*  180  degree  level 
turn  to  the  left*  180  degree  level  turn  to  the  right*  etraight 
and  level  flight  at  1*0.000  feet*  fast  rate  letdown  holding  mach 
1*0  (15*000-20*000  fpm),  level-off  at  20*000  feet*  jet  penetration 
maintaining  1*000  fpm  vertical  rate*  level-off  at  2300  feet*  and 
a  low  approach  at  1300  feet*  Instructions  were  given  before  each 
maneuver  or  groups  of  maneuvers  over  the  intercom  system*  All 
instructions  were  read  verbatim  from  typewritten  cards*  These 
instructions  are  reproduced  in  Appendix  A* 

Subjects  were  not  briefed  on  the  flight  task  and  no  in¬ 
dications  of  performance  level  were  given*  It  took  approximately 
35  minutes  to  complete  the  flight  task* 
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Scoring  Equipment 


Since  the  TF-102  flight  simulator  is  an  electronic  analog 
computer,  it  is  possible  to  measure  electrical  potentials  at 
various  points  in  the  system  that  would  be  directly  proportional 
to  the  flight  equation  values  of  the  different  flight  parameters* 
It  is  also  possible  to  set  up  reference  values  in  terms  of  elec¬ 
trical  potentials  that  would  correspond  to  a  level  of  desired 
performance*  The  difference  in  the  two  potentials  would  then 
describe  the  error  in  performance  for  the  selected  flight  para¬ 
meter*  Apparatus  was  installed  to  measure  these  errors  for  the 
flight  parameters  of  heading,  altitude,  mach,  vertical  rate, 
and  airspeed*  The  error  voltage  was  squared  and  integrated  with 
time  for  a  period  of  one  minute  for  each  scoring  period  through 
the  use  of  an  EA  computer.  The  resultant  error  term  was  read¬ 
out  on  a  digital  voltmeter  on  the  experimenter's  scoring  panel, 
shown  in  Figure  U*  Square  root  extraction  then  provided  an 
error  root  mean  square  (RMS)  score* 

Table  2  presents  the  selected  parameters  that  were  scored 
during  each  maneuver*  As  the  table  shows,  a  total  of  22  data 
points  were  obtained  for  each  flight.  These  error  scores  were 
recorded  on  a  scoring  sheet  that  was  designed  to  assist  the 
experimenter  in  proper  scoring  procedure  and  ease  of  measure¬ 
ment  recording*  It  is  reproduced  in  Appendix  B.  Every  effort 
was  made  to  insure  consistently  precise  scoring  procedures  for 
each  flight.  A  standardized  procedure  was  established  and 
followed  explicitly.  It  is  described  in  Appendix  C. 

Two  modes  of  scoring  were  available.  When  the  Master 
Scoring  switch  was  placed  in  the  "Man"  setting,  the  scoring 
period  began  immediately  upon  depressing  the  "Start"  button* 

With  the  Master  Scoring  switch  in  the  "Auto"  position,  de¬ 
pression  of  the  "Start"  button  armed  the  system  to  begin  scor¬ 
ing  when  the  rate  of  vertical  movement  reached  exactly  zero* 

This  mode  was  used  primarily  to  score  level-offs*  In  both 
modes,  the  scoring  period  consisted  of  an  automatically-timed 
one  minute  interval* 

Equipment  limitations  made  it  necessazy  to  limit  the  area 
about  the  index  of  desired  performance  (IDP)  that  could  be  scor¬ 
ed*  The  size  of  the  available  area  that  was  utilized  was  regu¬ 
lated  by  the  results  of  p  re -experimental  testing.  The  following 
scoring  limits  were  set  up  as  being  compatible  with  subject  capa¬ 
bilities*  Errors  of  performance  larger  than  their  respective 
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Flight  parameters  scored  during  each  maneuver  of 
the  flight  task* 


Man* 

Ho. 

Maneuver 

Altitude 

Heading 

Mach 

Vert  Bate 

Airspeed 

la 

Climb  at  *85  roach 

X 

X 

lb 

Climb  at  *85  roach 

X 

X 

2 

Level-off  at  lt0,000» 

X 

X 

3 

180°  left  turn 

X 

h 

180°  right  turn 

X 

5 

Straight  &  level 

X 

X 

6 

Fast  rate  letdown 

X 

X 

7 

Level-off  at  20,000* 

X 

X 

8 

Outbound  penetration 

X 

X 

9 

Penetration  turn 

X 

10 

Level-off  at  2300* 

X 

X 

11 

Low  approach 

X 

X 

X 

Total  tinea  scored 

7 

9 

3 

2 

1 
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Halts  vers  treated  as  maximum  limit  errors* 

Heading  2  10  degrues 

Altitude  1  800  feet 

Vertical  Rate  1  2,000  feet  per  minute 
Mach  2  *12  mach 

Airspeed  1  30  knots 

The  parameters  of  vertical  rate  and  airspeed  were  scored 
at  just  one  value  for  the  IDP,  liOOO  fpm  down  and  170  knots  re¬ 
spectively*  The  reference  voltages  for  these  parameters  were 
set  up  within  the  computer  racks  of  the  TF-102.  The  parameters 
of  heading,  altitude,  and  mach  were  scored  at  more  than  one  value 
for  the  IDP,  however,  so  the  capability  was  provided  for  adjust¬ 
ing  reference  voltages  from  the  experimenter's  panel*  Precise 
adjustment  was  made  possible  through  the  use  of  10  turn  100K 
reference  helipots* 


Experimental  Procedure 


All  subjects  performed  the  flight  task  once  while  using 
each  panel  configuration*  Order  of  presentation  of  the  -  two 
panels  was  counter-balance  dr  15  subjects  started  on  the  stan¬ 
dard  panel  and  ended  on  the  vertical  reading  panel,  and  15 
subjects  started  on  the  vertical  reading  panel  and  ended  on 
the  standard  panel*  This  procedure  was  necessary  to  counter¬ 
act  any  bias  due  to  learning  effect* 

Each  flight  on  either  panel  was  preceded  by  a  cockpit 
check  and  a  10  minute  practice  session*  Details  are  present¬ 
ed  in  Appendix  D* 

An  optimum  time  of  three  days  between  flights  on  the  two 
panel  configurations  was  selected  as  being  most  suitable  from 
the  standpoint  of  mechanization  problems  of  changing  instru¬ 
ments,  re-calibrating  the  scoring  equipment,  and  not  allowing 
too  much  time  to  pass  between  flights*  The  achieved  time  in¬ 
tervals  between  flights  were  as  follows  *  73*3  hours  for  all 
30  subjects,  71*9  hours  for  the  15  subjects  who  started  on 
the  standard  instruments  first,  and  7li*7  hours  for  the  15 
subjects  who  started  or  the  vertical  reading  instruments  first* 
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RESULTS 


The  significance  of  differences  in  pilot  performance  while 
using  standard  reading  primary  flight  instruments  as  compared  to 
performance  while  using  vertical  reading  primary  flight  instru¬ 
ments  was  tested  by  the  analysis  of  variance  technique  for  a 
treatment  x  treatment  x  subjects  without  replication  design  as 
described  in  Lindquist  (1953)  for  the  flight  parameters  of  head¬ 
ing,  altitude,  mach,  and  vertical  rate*  Differences  in  perfor¬ 
mance  for  the  parameter  of  airspeed  were  tested  for  significance 
by  the  t  test  method  as  described  in  Edwards  (1950)*  Because 
some  of  the  pilots  had  previous  vertical  reading  instrument  ex¬ 
perience,  it  was  deemed  necessary  to  insure  that  simple  exper¬ 
ience  differences  did  not  account  for  the  primary  performance 
differences  between  instruments*  Accordingly,  separate  analyses 
were  completed  for  the  experienced  and  non-experienced  groups, 
as  well  as  all  subjects  combined*  * 


Heading  Control 


Tables  3 $  and  5  summarize  the  analyses  as  applied  to 

performance  differences  for  the  flight  parameters  of  heading* 

In  the  case  of  this  parameter,  the  heading  display  remained 
oonstant  while  the  side  instruments  of  mach,  airspeed,  altitude 
.  and  vertical  rate  were  changed  from  standard  to  vertical  read¬ 
ing*  Table  3  shows  the  results  for  all  30  subjects*  Table  h 
shows  the  results  for  the  13  subjects  who  had  previous  verti¬ 
cal  reading  instrument  experience,  and  Table  5  shows  the  re¬ 
sults  for  the  17  remaining  subjects  who  had  no  previous  exper¬ 
ience  with  vertical  reading  instruments*  Inspection  of  the 
table  indicates  a  significant  between  instruments  difference 
with  varying  levels  of  significance  on  all  three  analyses* 


*  Sunmary  tables  containing  the  mean  RMS  error  scores  by  maneu¬ 
vers  for  experienced,  non-experienced,  and  all  subjects  on 
standard  and  vertical  reading  instrument  performance  are 
presented  in  Appendix  E. 


These  differences  were  ell  in  favor  of  better  heading  con¬ 
trol  while  using  the  standard  reading  side  instruments.  Be¬ 
tween  maneuvers  differences  all  proved  significant  at  the 
,001  level,  but  since  no  effort  was  made  to  equate  the  dif¬ 
ficulty  of  the  maneuvers,  a  significant  difference  would  be 
expected.  Likewise,  the  significant  between  subjects  dif¬ 
ferences  shown  in  all  three  tables  would  be  expected.  Sig¬ 
nificant  interaction  effects  appear  in  all  three  tables. 


Table  3 


Analysis  of  variance  results  for  heading  performance 
with  standard  versus  vertical  reading  side  flight 
instruments  for  all  subjects,  N-30. 

Sum  of  Mean 


Source  of  variation 

Squares 

df 

Square 

P 

Panels 

13*782 

1 

13.782 

13*068##* 

Maneuvers 

110,631 

8 

13*829 

13*133#** 

Subjects 

255*311 

29 

5*356 

$,086*## 

I  x  M 

8.756 

8 

1.091* 

1.039 

1  x  S 

50*926 

29 

1.756 

1.668# 

M  x  S 

352.327 

232 

1.519 

1,14*3## 

I  xM  x  S 

2M.396 

232 

1.053 

Total 

936.129 

539 

*##  ,1*  Sig. 
**  1*  Sig, 
*  $5  Sig. 


fable  1* 


Analysis  of  variance  results  for  heading  performance 
with  standard  versus  vertical  reading  side  flight 
instruments  for  13  subjects  with  vertical  instrument 
experience. 


Source  of  variation 

Sum  of 
Squares 

df 

Mean 

Square 

P 

Panels 

l*.ot*o 

1 

1*.01*0 

1*.01<0» 

Maneuvers 

69*090 

8 

8.636 

8.636*** 

Subjects 

1*1**767 

12 

3*731 

3.731#** 

I  xM 

9*21*3 

8 

1.155 

1.155 

I  x  S 

20.01*1 

12 

1.670 

1.670 

M  x  S 

11*3.712 

96 

1.1*97 

1.1*97* 

I  x  M  x  S 

95.973 

96 

1.000 

Total 

386*866 

233 

**»  .IS  Sic 
»  S%  Sig 

fable  5 

Analysis  of  variance  results  for  heading  performance  with 
standard  versus  vertical  reading  side  flight  instruments 
for  17  subjects  with  no  vertical  instrument  experience. 


Source  of  variation 

Sum  of 
Squares 

df 

Mean 

Square 

r 

Panels 

10*071* 

1 

10.071* 

9.285#* 

Maneuvers 

1*8.51 5 

8 

6.061* 

5.589*** 

Subjects 

110.1*87 

16 

6.905 

6.361**** 

I  xM 

9.118 

6 

1.11*0 

1.051 

I  x  S 

30*553 

16 

1.910 

1.760* 

M  x  S 

201.6  ia 

128 

1.575 

1.1*52* 

I  X  M  x  S 

138*818 

128 

1.085 

51*9*206  305  **»  .1*  Sig. 

**  1*  Sig. 
*  55  Sig. 


Total 


Tables  6,  7 $  and  8  summarize  the  results  of  the  analyses 
as  applied  to  performance  differences  for  the  flight  parameter 
of  altitude.  Table  6  presents  the  results  for  all  30  subjects* 
while  Table  7  presents  the  results  for  the  13  subjects  who  had 
previous  vertical  instrument  experience  and  Table  8  presents 
the  results  for  the  remaining  17  subjects  who  had  no  previous 
experience  with  vertical  reading  instruments.  All  three  tables 
indicate  a  significant  between  instruments  difference  at  the 
•001  level*  In  each  case*  the  difference  indicated  better  pilot 
performance  wWle  using  the  standard  reading  altimeter*  The  be¬ 
tween  maneuvers  differences  are  shown  to  be  significant  at  the 
•001  level  for  all  three  analyses*  as  are  the  between  subjects 
differences*  Again*  these  differences  would  be  expected  to  be 
significant*  Several  significant  interaction  effects  are  also 
noted  in  all  three  tables* 


Table  6  i 

I 

* 

Analysis  of  variance  results  for  altitude  performance 
on  standard  versus  vertical  reading  flight  instruments 


for  all  subjects* 

Source  of  variation 

N-30. 

Sum  of 
Squares 

df 

Mean 

Square 

r 

Instruments 

112*2*721 

1 

112.2*72* 

88.210*** 

Maneuvers 

160*372 

6 

26.729 

20*962**** 

Subjects 

230*573 

29 

7.951 

6.236*** 

I  xM 

51.989 

6 

8.665 

6.796*** 

I  x  3 

37.255 

29 

1.285 

1*008 

MxS 

360.172* 

172* 

2*070 

1*622*** 

X  x  It  x  S 

221*890 

172* 

1.275 

Table  7 


Analysis  of  variance  results  for  altitude  performance 
on  standard  versus  vertical  reading  flight  instruments 
for  13  subjects  with  vertical  instrument  experience. 


Source  of  variation 

Sum  of 
Squares 

df 

Mean 

Square 

P 

Instruments 

1*6.836 

1 

1*6.836 

30.552*** 

Maneuvers 

ft.OliO 

6 

9.007 

5.875*** 

f 

Subjects 

11*8.102 

12 

12.368 

8.068*** 

I  x  M 

22.296 

6 

3.7X6 

2.1*21** 

I  x  S 

a.327 

12 

2.027 

1.322 

A  x  S 

226.698 

72 

3.1U8 

2.053** 

I  x  M  x  S 

110.381 

72 

1.533 

Total 

632.950 

181 

***  .1*  Sig, 
**  l£  Sig, 
*  $%  Sig, 

Table  8 

Analysis  of  variance  results  for  altitude  performance 
on  standard  versus  vertical  reading  flight  instruments 
for  17  subjects  with  no  vertical  instrument  experience. 


Sum  of  Mean 


Source  of  variation 

Squares 

df 

WtSmxWM 

F 

Instruments 

65.673 

1 

65.673 

59.272*** 

Maneuvers 

113.033 

6 

18.839 

17.003*** 

Subjects 

78.551 

16 

1.909 

1*.1*31*»* 

I  x  M 

31*.  795 

6 

5.799 

5.231**** 

I  x  S 

12.893 

16 

.806 

mm 

M  x  S 

126.815 

96 

1.321 

1.192 

2  x  M  x  S 

106.1*07 

96 

1.108 

Total 

538.167 

237 

***.lf  Sig, 

Mach  Control 


Tables  9t  1° $  and  11  summarize  the  results  of  the  analyses 
as  applied  to  performance  differences  for  the  flight  parameter 
of  mach.  Table  9  presents  the  results  for  all  30  subjects,  while 
Table  10  presents  the  results  for  the  13  subjects  who  had  pre¬ 
vious  vertical  instrument  experience  and  Table  11  presents  the 
results  for  the  remaining  17  subjects  who  had  no  previous  ex¬ 
perience  with  vertical  reading  instruments*  A  significant  be¬ 
tween  instruments  difference  at  the  *001  level  is  indicated  on 
all  three  tables*  In  all  three  cases,  this  difference  favored 
better  mach  performance  while  using  the  vertical  reading  instru¬ 
ment*  A  significant  between  maneuvers  effect  at  the  *001  level 
will  again  be  noted  for  each  analysis.  Between  subjects  dif¬ 
ferences  are  significant  at  the  *01  level  for  all  three  analyses* 
Further  inspection  will  indicate  several  interaction  effects 
significant  at  the  *01  level* 


Table  9 

Analysis  of  variance  results  for  mach  performance  on 
standard  versus  vertical  reading  flight  instruments 
for  all  subjects*  N"30. 


Source  of  variation 

Sum  of 
Squares 

df 

Mean 

Square 

F 

Instruments 

69.311 

1 

69*311 

78.1*95*** 

Maneuvers 

198.380 

2 

99.190 

112.333*** 

Subjects 

87.1*16 

29 

3.011* 

3.1*13*** 

I  xM 

20.917 

2 

10.1*59 

11.81*5*** 

I  x  S 

16.357 

29 

.561* 

*■  «• 

K  x  S 

103.01*0 

58 

1.777 

2.012** 

I  xM  x  S 

51.215 

58 

.883 

***  *1*  Sig* 
**  1*  Sig* 


Total 


516*636  175 


Table  10 


Analysis  of  variance  results  for  mach  performance  on 
standard  versus  vertical  reading  flight  instruments 
for  13  subjects  with  vertical  instrument  experience* 


Source  of  variation 

Sum  of 
Squares 

df 

Mean 

Square 

F 

Instruments 

30*162 

1 

30.162 

iili*8l7*«* 

Maneuvers 

81u776 

2 

1*2.388 

62*981i#*» 

Subjects 

33*651* 

12 

2.80$ 

1i*168*# 

I  xM 

17.520 

2 

8*760 

13*016*## 

I  x  S 

7.638 

12 

.637 

m  m 

M  x  S 

22*116 

21* 

.922 

1.370 

I  X  M  x  S 

16*153 

2k 

.673 

Total 

212*019 

77 

*»*  *1£  Si| 

**  1*  Sig. 


Table  11 

Analysis  of  variance  results  for  roach  performance  on 
standard  versus  vertical  reading  flight  instruments 
for  17  subjects  with  no  vertical  instrument  experience* 


Source  of  variation 

Sun  of 
Squares 

df 

Mean 

Square 

F 

Instruments 

39.11*2 

1 

39.11*2 

38.761*#* 

Maneuvers 

115.096 

2 

57.51*8 

$6,978##* 

Subjects 

53.091* 

16 

3.318 

3*285** 

2  xM 

6.152 

2 

3.076 

3*01*6 

I  x  S 

8*719 

16 

•5U5 

-  - 

M  x  S 

79.1*3 2 

32 

2.1*82 

2.1*57 *» 

2  x  M  x  S 

32.307 

32 

1*010 

***  ,1*  Sig. 
**  1*  Sig* 


Total 


333 .91*9  101 


Vertical  Rate  Control 


Tables  12,  13,  and  lb  summarize  the  results  of  the  analyses 
as  applied  to  performance  differences  for  the  flight  parameter 
of  vertical  rate*  Table  12  presents  the  results  for  all  30  sub¬ 
jects,  while  Table  13  presents  the  results  for  the  13  subjects 
who  had  previous  vertical  instrument  experience  and  Table  lb 
presents  the  results  for  the  remaining  17  subjects  who  had  no 
previous  experience  with  vertical  instruments*  Inspection  of 
these  tables  reveals  that  no  significant  differences  were  found 
in  performance  on  standard  versus  vertical  reading  presentation 
of  vertical  rate  flight  information*  With  just  two  maneuvers 
Involved,  the  tables  also  indicate  that  between  maneuvers  dif¬ 
ferences  were  not  significant.  Between  subjects  differences 
proved  significant  at  the  *01  level  or  better*  The  instru¬ 
ments  by  subjects  interaction  effect  for  all  30  subjects  was 
significant  at  the  *05  level* 


Table  12 

Analysis  of  variance  results,  fbr  vertical  rate  performance 
on  standard  versus  vertical  reading  flight  instruments 
for  all  subjects*  N*30* 


Sum  of  Mean 


Source  of  variation 

Squares 

df 

Square 

F 

Instruments 

•010 

1 

•010 

m  ' 

Maneuvers 

2.303 

1 

2.303 

2*b90 

Subjects 

lb7.502 

29 

5*086 

5.b98*** 

I  xM 

3*b21 

1 

3.b21 

3.698 

1x3 

5b.b85 

29 

1.879 

2.031* 

M  x  3 

29.913 

29 

1.031 

1.115 

I  x  M  x  S 

26*826 

29 

.925 

Total 

26b.b60 

119 

«**  .1*  Sig. 
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Table  13 

Analysis  of  variance  results  for  vertical  rate  performance 
on  standard  versus  vertical  reading  flight  instruments  for 
13  subjects  with  vertical  instrument  experience. 

Sum  of  Mean 


Source  of  variation 

Squares 

df 

Square 

F 

Instruments 

•915 

1 

.915 

m  m 

Maneuvers 

.710 

1 

.710 

-- 

Subjects 

69.593 

12 

5.799 

5.828** 

I  xM 

3.998 

1 

3.998 

U.018 

I  x  S 

29.973 

12 

2.U98 

2.511 

M  x  S 

U*.li63 

12 

1.205 

1.211 

I  xM  x  S 

11.937 

12 

.995 

« 

Total 

131.589 

51 

**  1*  Sig. 

Table  Hi 

Analysis  of  variance  results  for  vertical  rate  performance 
on  standard  versus  vertical  reading  flight  instruments  for 
17  subjects  with  no  vertical  instrument  experience. 


Source  of  variation 

Sum  of 
Squares 

df 

’  Mean 
Square 

P 

Instruments 

.693 

1 

.693 

m  m 

Maneuvers 

1.637 

1 

1.637 

1.886 

Subjects 

77.886 

16 

U.868 

5.608*** 

I  xM 

•U27 

1 

.1427 

m  m 

I  x  S 

22.9114 

16 

1.U32 

1.650 

M  x  S 

15.U06 

16 

.963 

1.10? 

I  xM  x  S 

13.885 

16 

•868 

Total 

132.8148 

67 

«**  .15  Sig. 

Airspeed  Control 


Table  15  summarizes  the  t  test  analyses  of  the  RMS  error 
differences  for  the  flight  parameter  of  airspeed*  As  the 
table  indicates,  no  significant  difference  in  performance 
between  the  standard  and  vertical  reading  airspeed  indicator 
was  found  for  all  30  subjects,  or  for  the  experienced  and 
non-experience d  groups*  These  analyses  covered  just  one 
maneuver,  the  low  approach  at  1300  feet  while  maintaining 
a  heading  of  230  degrees  and  an  airspeed  of  170  knots* 


Table  1$ 


Results  of  t  tests  on  differences  in  mean  airspeed 
RMS  error  on  standard  and  vertical  reading  flight 
instruments* 


Subject  Group 

t 

df 

Sig* 

13  Experienced  Subjects 

.926 

2U 

NS 

17  Hon-Experlenced  Subjects 

•881 

32 

NS 

All  30  Subjects 

1.301 

58 

NS 

Individual  Maneuver  by  Flight  Parameter  Analysis 


To  further  test  the  significance  of  differences  in  the 
IMS  error  scores  by  maneuvers  for  the  flight  parameters  of 
heading^  altitude,  mach,  and  vertical  rate  between  standard 
and  vertical  reading  instruments,  individual  t  tests  were 
computed  for  each  maneuver  by  parameter  for  all  30  subjects* 
The  results  of  these  tests  are  summarised  in  Tables  16,  17, 
18,  and  19*  3b  general,  these  tables  substantiate  fully  the 
results  of  the  analyses  of  variance  performed  on  the  data* 
The  individual  tables  are  reviewed  below* 


Heading  Maneuver  Performaice 

Table  16  presents  the  results  of  the  individual  maneuver 
t  tests  on  heading  performance*  It  should  again  be  remember¬ 
ed  that  the  heading  instrument  remained  the  same  while  the 
side  instruments  were  changed  from  standard  to  vertical  read¬ 
ing*  The  table  shows  that  after  submitting  the  differences 
in  RMS  error  score's  for  each  maneuver  to  the  t  test,  only  one 
maneuver,  the  level-off  at  2300  feet,  proved  significant  at 
the  *05  level  in  favor  of  performance  with  the  standard  read¬ 
ing  side  instruments*  However,  when  the  cumulative  effect  of 
RKS  error  scores  for  all  maneuvers  was  subjected  to  a  t  test 
for  the  differences  in  performance,  a  significant  difference 
at  the  *01  level  in  favor  of  performance  with  the  standard 
reading  side  instruments  was  recorded*  This  is  in  agreement 
with  the  results  of  the  analysis  of  variance  previously 
reported* 


Table  16 


Results  of  t  tests  on  differences  in  mean  heading 
IMS  errors  with  standard  and  vertical  reading  side 
flight  instruments  for  all  subjects*  N«30* 


Man* 

No. 

Mean  on 
Standard 

Mean  on 
Vertical 

Kean 

Biff. 

df 

t 

Sig. 

la 

2.590 

3.251 

.661 

58 

1.211 

NS 

lb 

1.711 

1.725 

.011* 

58 

.052 

NS 

2 

1.889 

2.169 

•280 

58 

.956 

NS 

5 

1.3ft 

1.1*72 

.118 

58 

.605 

NS 

6 

1.157 

1.286 

.129 

58 

.721 

NS 

7 

1.826 

1.882 

.056 

58 

.176 

NS 

8 

1.1*85 

1.792 

.307 

58 

1.158 

NS 

10 

1.31*2 

2.020 

.678 

58 

2.201 

.05 

11 

1.536 

2.167 

.631 

58 

1.7li3 

NS 

All 

1.65b 

1.971* 

o 

CM 

«*> 

• 

538 

2.832 

•d 

Altimeter  Maneuver  Performance 


fi 

t 


Table  17  shove  that  altimeter  performance  vaa  signifi¬ 
cantly  better  at  the  *01  level  in  favor  of  the  standard 
reading  altimeter  for  all  maneuvers  except  one*  On  this 
maneuver,  the  level-off  at  20,000  feet,  no  statistically 
significant  difference  in  performance  between  instruments 
was  found* 


Table  17 


Results  of  t  tests  on  differences  in  mean  altitude 
RHS  errors  on  standard  and  vertical  reading  flight 
instruments  for  sll  subjects*  N-30. 


Man* 

No* 

Mean  on 
Standard 

Mean  on 
Vertical 

Kean 

Biff. 

df 

t 

Sig. 

2 

2.072 

3.861* 

1.752 

58 

3.507 

.01 

3 

1.108 

2.U3 

1.325 

58 

3.1*51 

.01 

I* 

1.385 

2.715 

1.330 

58 

3.205 

•01 

5 

.631* 

2.181* 

1.550 

58 

JU.669 

.01 

7 

2.21*8 

1.71*3 

.505 

5B 

1.336 

NS 

10 

1.067 

2.072 

1.005 

58 

3.*55 

•01 

11 

.1*26 

1.173 

.71*7 

5B 

2.881* 

•01 

-3I*< 


Mach  Maneuver  Performance* 


Table  18  indicates  that  nach  performance  on  the  vertical 
reading  instrument  was  significantly  better  at  the  *01  level 
than  performance  on  the  standard  reading  instrument  for  all 
three  maneuvers  involving  specific  mach  number  control* 


Table  18 

Results  of  t  tests  on  differences  in  mean  mach  RMS  errors 
on  standarcTand  vertical  reading  flight  instruments  for  all 
subjects*  N-30. 


Man* 

Vo. 

Mean  on 
Standard 

Mean  on 
Vertical 

Mean 

Diff. 

df 

t 

Sig. 

la 

ii*863 

2.671 

2*192 

58 

5.102 

•01 

lb 

2*1(58 

1.551» 

58 

2*852 

•01 

6 

1.577 

•950 

•627 

58 

3.503 

.01 

Vertical  Rate  Maneuver  Performance 


Table  19  indicates  no  differences  in  performance  op  either 
maneuver  involving  vertical  rate  control  on  standard  or  vertical 
reading  instruments*  k  small  difference  in  alternate  directions 
was  recorded,  but  as  Table  19  shows,  these  differences  were 
statistically  insignificant* 


Table  19 

Results  of  t  teste  on  differences  in  mean  vertical  rate 
RMS  errors  on  standard  and  vertical  reading  flight  in¬ 
struments  for  all  subjects*  N-30. 


Man* 

Vo* 

Mean  on 
Standard 

•Mean  on 
Vertioal 

.  Mean 
Riff* 

df 

t 

*  Sig. 

8 

3.755 

U*07U 

.319 

58 

..780 

vs 

9 

3.815 

3.U60 

.355 

58 

.563 

vs 

Ixperlancodvs  Mon-Expcrlenced  Performance 
oo  Vertical  Reading  3&s8trm^t8 


To  toot  the  differences  in  performance  of  experienced 
torsos  non-expo rienced  pilots  on  vertical  reading  flight  in¬ 
struments,  it  was  necessary  to  ferret  out  those  experienced 
and  non-experienced  subjects  who  had  performed  on  the  instru¬ 
ment  configurations  in  the  same  order  of  presentation.  It 
oas  found  that  8  experienced  and  7  non-experienced  subjects 
had  flown  the  vertical  reading  instrument  configuration  first. 
The  distribution  of  subjects  who  had  flown  the  vertical  read¬ 
ing  instrument  configuration  last  was  less  balanced,  5  exper¬ 
ienced  and  IX)  non-experienced,  because  no  attest  was  made  to 
control  the  order  of  appearance  of  the  subjects.  The  RMS  error 
scores  for  the  group  who  performed  on  the  vertical  reading  in¬ 
struments  first  were  compared  by  t  tests  for  the  flight  para¬ 
meters  of  heading  and  altitude.  ?he  results  are  summarized  in 
Tables  20  and  21.  These  tables  indicate  that  there  ware  no 
significant  differences  in  performance  on  heading  and  altitude 
oontrol  on  any  of  the  maneuvers  while  using  the  vertical  read¬ 
ing  instruments  between  the  selected  experienced  and  non- 
experienced  subject  groups. 

Table  20 

Results  of  t  tests  on  differences  in  mean  heading  perfor¬ 
mance  with  the  vertical  reading  side  instruments  for  the 
experienced  and  non-experienced  subjects  who  performed  on 
tho  vertical  reading  instruments  first. 


Maneuver 

Number 

Experienced 
Mean  N"8 

Non-Experienced 

Mean  N-7 

Kean 

Diff. 

df 

t 

Sig. 

la 

2*935 

3.001 

.066 

13 

.075 

NS 

lb 

1.71*9 

1.21*0 

.509 

13 

1.1*51* 

NS 

2 

1.957 

2.660 

.703 

13 

1.031 

NS 

$ 

1*268 

1.751* 

•1*86 

13 

1.1|59 

NS 

6 

.998 

1.198 

•200 

13 

•1*61 

NS 

7 

1.637 

1.987 

.350 

13 

•50b 

NS 

8 

1.91*1 

1.775 

•166 

13 

-3- 

CM 

n 

• 

NS 

10 

1.299 

2.830 

1.531 

13 

1.879 

NS 

n 

2.1*96 

2.111 

.385 

13 

.379 

NS 

06- 


Table  21 


Results  of  t  tests  on  differences  in  mean  performance 
on  the  vertical  reading  altimeter  for  the  experienced 
and  non-experienced  subjects  who  performed  on  the 
vertical  reading  instruments  first* 


Maneuver 

Number 

Experienced 
Mean  N*  8 

Mon-Experienced 
Mean  N»7 

Mean 
Diff  • 

df 

t 

Sig* 

2 

3.U90 

3.526 

•036 

13 

.oao 

NS 

3 

2.590 

1.937 

.653 

13 

•594 

NS 

k 

1.953 

2.789 

•836 

13 

1*201 

NS 

5 

1.670 

.899 

.771 

13 

1.637 

NS 

7 

1.876 

2.045 

•169 

13 

•202 

NS 

10 

1.968 

2.028 

•ouo 

13 

•112 

NS 

11 

1.358 

1.093 

.265 

13 

.311 

NS 

Altimeter  Reading  Errors 


Throughout  the  flight  task,  the  experimenter  maintained 
a  vigilant  look-out  for  evidence  of  altimeter  reading  errors 
on  both  altimeter  displays*  Mo  altimeter  reading  errors  were 
detected  at  any  point  throughout  the  profile  under  either  dis- 
play  configuration* 

A  specific  scoring  point  was  set  up  on  the  scoring  sheet 
to  reoord  the  altitude  at  which  the  penetration  turn  was  com¬ 
menced*  All  penetration  turns  were  initiated  within  t  200 
feet  of  the  instructed  altitude  for  either  altimeter*  This 
is  considered  to  be  within  the  performance  criteria  limits 
that  most  pilots  set  for  themselves,  and  is  not  regarded  as 
any  kind  of  reading  error* 


DISCUSSION  OP  RESULTS 


This  study  represents  one  of  the  first  attempts  to  measure 
and  evaluate  pilot  simulator  performance  on  the  whole  panel  basis* 
It  has  been  common  practice  to  evaluate  performance  on  one  type 
of  instrument,  usually  with  the  major  emphasis  on  "good"  perfor¬ 
mance  being  assigned  to  that  particular  instrument*  In  reality, 
"good1*  performance  must  come  as  a  result  of  proper  fading  and 
interpretation  of  several  flight  instruments*  To  remove  one,  or 
possibly  two,  instruments  from  the  panel  and  direct  investigation 
towards  performance  on  them,  is  not  looking  at  the  entire  infor¬ 
mational  context  of  the  pilot* s  task*  Provision  should  be  made 
to  record  performance  on  all  instruments  contributing  to  the 
display  of  information  required  by  tie  pilot  to  maintain  the 
desired  flight  path*  The  present  study  was  designed  to  accom¬ 
plish  this  objective* 


Why  Vertical  Instruments 


The  need  for  a  shift  to  vertical  reading  instruments  was 
necessitated  by  a  number  of  reasons,  among  which  are  the 
following t 

1*  Not  enough  room  for  scale  length  on  the  circular 
dials* 

2*  No  feasible  method  available  for  displaying  command 
information* 

3*  In  the  case  of  the  thru-*  pointer  altimeter,  the 
inherent  interpretation  error  characteristic*. 

However,  as  previously  stated,  such  a  shift  in  display  prin¬ 
ciple  must  assume  a  corresponding  shift  of  equal  or  better 
pilot  performance  to  the  new  instrument  display  technique* 
Unless  this  is  accomplished,  anything  else  gained  by  the 
change  would  be  offset  by  degradation  in  performance* 

The  present  study  has  examined  differences  in  pilot  sim¬ 
ulator  performance  on  two  flight  parameter  display  principles 
only*  These  principles  are  circular  dials  versus  vertical 
moving-tapes*  It  is  not  a  comparison  of  the  Air  Fores  Phase 
n  Panel  and  the  round  standard  reading  instruments*  The  Phase 


II  instruments  provided  a  convenient  vehicle  from  which  to  ob¬ 
tain  vertical  reading  moving- tape  displays  of  flight  parameter 
information*  Conclusions  can  only  be  extracted  from  the  results 
in  terms  of  these  display  principles*  Any  extrapolation  to  the 
Phase  H  Panel  must  be  viewed  with  full  cognisance  that  the 
Phase  II  Panel  adds  still  a  third  display  principle  —  that  of 
the  use  of  command  indices*  It  can  logically  be  assumed  that 
the  addition  of  command  markers  should  improve  performance,  but 
this  is  an  assumption  which  can  be  tested  experimentally  and 
suggests  another  pilot  performance  measurement  stuty,  comparing 
performance  on  vertical  reading  instruments  with  and  without 
command  information* 


Interpretation  of  the  Findings 


Reviewing  the  results,  it  was  indicated  that  heading  per¬ 
formance  was  superior  while  using  the  standard  reading  side  in¬ 
struments,  altitude  performs  ace  was  superior  while  using  the 
standard  reading  altimeter,  mach  performance  was  superior  while 
using  the  vertical  reading  mach  indicator,  and  vertical  rate  and 
airspeed  performance  showed  no  differences  between  instrument 
configurations.  Separate  analyses  for  those  subjects  with  and 
without  vertical  instrument  experience  did  not  change  the  results 
of  the  overall  analyses* 


Mach*  Vertical  Rate*  and  Airspeed 

In  the  light  of  the  previous  discussion,  the  results  of 
the  present  study  v*Y  b«  interpreted  in  this,  manner*  Perfor¬ 
mance  on  the  vertical  leading  instruments  for  mach,  vertical 
rate,  and  airspeed  was  found  to  be  essentially  equivalent  to 
or  better  than  performance  on  the  standard  reading  instruments 
for  the  s&me  flight  parameters.  As  a  result,  it  may  be  con¬ 
cluded  that  no  degradation  in  performance  may  be  expected  on 
a  shift  from  standard  to  vertical  reading  instruments  for  ths 
flight  parameters  of  mach,  vertical  rate,  and  airspeed  with 
scale  factors  comparable  to  those  used  in  this  study*  Such  a 
shift  would  only  involve  a  change  to  vertical  moving-tape  dis¬ 
plays  without  conmand  markers*  However,  by  making  the  change 
to  vertical  reading  displays,  it  is  then  possible  to  overcome 
the  eoale  length  limitations  of  circular  dials  and  to  make  the 
addition  of  conr-and indices.  As  previously  suggested,  a  logical 
assumption  would  call  for  the  expectation  of  better  performance 
with  the  command  markers  added  to  the  vertical  display*  Human 


factors  experimentation  could  test  this  assumption* 


Altitude 


Altitude  performance  results  present  a  somewhat  different 
picture*  The  results  indicated  that  performance  on  the  standard 
three-pointer  altimeter  was  superior  to  that  obtained  on  the 
vertical  reading  altimeter*  From  previous  work  by  Mengelkoch 
and  Houston  (1958a,  1958b,  1958c),  these  performance  differences 
oan  probably  be  attributed  to  a  large  extent  to  the  problem  of 
scalar  design*  The  scale  factor  in  the  vertical  reading  altimeter 
(2N  per  1000' )  is  not  conducive  to  equivalent  performance  with 
that  on  the  standard  reading  instrument*  Again,  the  prior  work 
of  Mengelkoch  and  Houston  suggest  the  direction  of  change  to  bo 
used  in  an  attempt  to  produce  equivalent  performance  on  the  two 
types  of  altitude  display  principles*  An  expansion  of  the  lin¬ 
ear  scale  factor  on  the  vertical  moving-tape  is  suggested*  Ke- 
cently,  other  proposals  for  increasing  the  sensitivity  of  alti¬ 
tude  moring-tape  presentations  have  been  suggested  by  Gainer 
(1959a)*  These  include  the  introduction  of  non-linear  scales, 
combinations  of  non-linear  scales,  combinations  of  linear  and 
non-linear  scales,  and  combinations  of  linear  scales*  Experi¬ 
mental  evaluation  of  these  scales  has  been  recommended  (Gainer, 
1959b)  and  is  scheduled  for  early  completion.  It  is  anticipated 
that  the  results  of  the  forthcoming  studies  will  produce  an  alti¬ 
tude  moving-tape  scale  that  will  promote  performance  at  least 
equivalent  to  that  obtained  on  the  three-pointer  altimeter* 

Once  this  point  has  been  reached,the  shift  to  a  vertical  read¬ 
ing  altimeter  will  be  justified*  In  addition  to  no  performance 
degradation,  the  capability  of  command  marker  presentation  and 
the  virtual  elimination  of  interpretation  errors  will  make  the 
vertical  reading  altimeter  a  valuable  asset  to  modern-day  aviation* 


Heading 

Heading  performance  was  recorded  on  nine  maneuvers,  each 
someidiat  different  from  the  other*  It  will  be  recalled  that 
the  heading  instrument  itself  was  not  changed  for  the  two  dif¬ 
ferent  panel  configurations*  Along  with  the  Attitude  Director 
Indicator,  it  remained  the  same  while  the  side  instruments  for 
mach,  airspeed,  altitude,  and  vertical  rate  were  alternated* 

A  highly  significant  difference  at  the  *001  level  was  shown  to 
favor  performance  with  the  standard  reading  side  instruments 
for  all  30  subjects*  The  difference  in  performance  for  the  17 
subjects  with  no  previous  vertical  instrument  erperience  was 
significant  at  the  *01  level  in  favor  of  performance  with  the 


standard  reading  aide  instruments#  The  level  of  significance 
for  the  difference  in  performance  for  the  13  subjects  with 
previous  vertical  Instrument  experience  dropped  to  the  #05 
level,  still  in  favor  of  performance  witn  the  standard  read¬ 
ing  side  instruments#  It  is  tempting  to  interpret  these  re¬ 
sults  as  indicating  that  previous  experience  with  vertical 
reading  Instruments  does  not  influence  performance  on  heading 
oontrol#  If  the  #05  level  of  significance  is  acceptable,  it 
night  be  concluded  that  previous  experience  had  no  effect  on 
heading  performance,  and  that  heading  control  remained  super¬ 
ior  for  the  panel  configuration  with  the  standard  reading  side 
instruments,  regardless  of  an y  previous  experience  with  vert¬ 
ical  reading  instruments#  From  the  strictly  statistical  ap¬ 
proach,  it  is  necessary  that  the  #05  level  of  significance  be 
accepted  on  the  basis  of  p  re -experimental  decision.  However, 
from  the  operational  viewpoint,  there  appears  to  be  some  in¬ 
dication  that  prior  experience  with  vertical  reading  instru¬ 
ments  seemed  to  allow  more  time  for  heading  monitoring  aside 
from  primary  pitch  control  under  the  conditions  of  this 
experiment. 

Since  performance  on  the  Horizontal  Situation  Indicator 
was  not  compared  to  that  of  any  other  heading  indicator,  this 
discussion  is  purely  speculative.  The  heading  indicator  was 
used  primarily  as  a  control  instrument  to  indicate  the  effect 
that  changing  of  the  side  instruments  might  have  on  heading 
performance.  Although  not  statistically  supported,  as  pre¬ 
viously  stated,  this  procedure  provided  the  only  indication 
that  experience  level  (on  vertical  reading  instruments)  may 
have  some  effect  on  initial  porformancs. 
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TECHNICAL  APPENDICES 


APPENDIX  A 


Flight  Instructions 


The  following  flight  instructions  were  read  verbatim  from 
typewritten  cards  prior  to  the  Indicated  maneuver* 


Introductory  Statement 

Bov  do  you  read  me? 

Roger,  I  read  you  loud  and  clear* 

All  flight  instructions  vdll  have  a  definite  starting  command 
such  as  "Begin  NOW"* 

Please  do  not  initiate  any  maneuver  prior  to  receiving  this 
command* 

You  need  not  acknowledge  any  further  instructions,  however, 
feel  free  to  request  a  repeat* 

Tour  call  will  be  "Air  Force  59  "• 


Take-off.  Climb-out,  and  Level-off  at  1)0,000' 

Air  Force  59 

You  are  cleared  to  take-off  and  climb  on  a  heading  of  zero 
degrees* 

Use  10#  with  afterburner  for  the  climb. 

Stay  below  3000*  until  you  reach  mach  *80  and  then  set  up 
and  maintain  a  climbing  mach  of  *85* 

Level  off  at  1)0,000',  96%  without  afterburner,  and  maintain 
1)0,000'  and  a  heading  of  zero  degrees  until  further  advised* 
1  repeats  (repeat  the  instructions)* 

Begin  your  take-off  NOW. 


180°  Turn  to  the  Left 
Air  Force  59 

Tou  are  to  make  a  180  degree  LEVEL  TURN  TO  IKE  LEFT. 
Maintain  1)0,000' ,  use  a  30  degree  bank  and  your  present 
power  setting  of  96%  without  afterburner. 

Begin  your  turn  NOW. 


160°  Turn  to  the  Right 


Air  Force  59 

You  ere  to  make  a  ISO  degree  LEVEL  TORN  10  THE  RIGHT* 
Maintain  1*0,000  feet,  use  a  30  degree  bank  and  your 
present  power  setting  of  96%  without  afterburner* 
Begin  your  turn  NOW, 


Straight  and  Level  Flight 
Air  Force  59 

Maintain  1*0,000  feet,  heading  aero  degrees,  and  96%  until 
further  advised* 


Fast  Rate  Descent  to  20*000 1 
Air  Force  59 

You  are  cleared  to  descend  to  and  maintain  20,000  feet* 
Use  855  and  maintain  mach  1*0  during  the  descent* 

Leave  the  power  at  855  after  leveling  off  at  20,000  feet* 
Hold  your  heading  of  aero  degrees  throughout  the  maneuver* 
I  repeat*  (repeat  the  instruction)* 

Begin  NOW* 


Jet  Penetration 


Air  Force  59 

You  are  now  approaching  the  range  station  and  are  cleared 
tor  a  penetration* 

Refer  to  the  placard* 

After  passing  the  high  station,  extend  3/1*  speed  brakes  and 
set  up  a  1*000  foot  per  minute  r«te  of  descent* 

Leave  the  power  at  85%,  Begin  a  right  penetration  turn  at 
11,000  feet  using  a  30  degree  bank*  Inbound  heading  is 
230  degrees*  Level  off  at  2300  feet,  advance  power  to  92%, 
drop  the  landing  gear,  pull  in  the  speed  brakes,  and  main¬ 
tain  2300  feet  and  a  heading  of  230  degrees* 

X  repeat*  (repeat  the  instruction)* 

Standby  for  the  high  station* 


Low  Approach 

Air  Force  59 

You  are  now  four  miles  out  and  are  cleared  to  descend  to 


and  Maintain  1300  feet,  heading  230  degrees,  170  knot a* 
After  passing  the  low  station,  extend  particular  effort 
to  maintain  1300  feet,  230  degrees,  and  170  knots  until 
further  advised* 

Begin  your  descent  NOW. 


Flight  Termination 
Air  Force  $ 9 

That  completes  the  flight* 

The  Simla  tor  is  frozen. 

Canopy  ia  coning  up.  (Open  the  canopy). 


APPENDIX  B 


IAMB _ SUBJECT  NO. _ OOHDITIOM  _ 

Bank/Job  _________  Tine  lest  6  months  _________  Total  Tims 

Age  _  _____  Jet  Simul*  Time  __________  Instrument  Time_ 

Date  ________  Hhite/Ore en/GAA  Inst*  Card  Jet  Time 

Previous  vertical  instrument  experience*  Tes  j  No  1  )  Hours 


(1)  CLIMB  TO 

Mach 

(.85) 


Heading  [~  I 

(3600)  L - 1 

(3)  180°  IEFT  TURN 


latitude 

(1|0,CJ0*) 


(6)  FAST  RATE  PESCENT 

Mach  j  j 

(1.0)  1 - 1 

Heading  j  j 

/VflO*  I - 1 


Heading 

(360°) 


(9)  PENETRATION  TURN  (10)  JXVEL  OFF  2300* 


Mach 

(.85) 

(26,000*) 

1 _ 1 

Heading 

(3600) 

□ 

j  (A)  180°  RIGHT  TURN 

Altitude 

(1(0,000*) 

1  (7)  LEVEL  OFF  20.000* 

Altitude 

(20,000*) 

1 _ 1 

Heading 

(360°) 

1 _ ! 

Vert/Rate 
(1*000  fpn) 

Turn  Alt. 

(11,000*) 


Altitude 
(2300* ) 

Heading 

(230°) 


CZj 


(2)  U5VEL  OFF  1(0.000* 
Altitude  i  I 

(U0,000')  I - i 


Heading 

(360») 


(5)  SAL  1(0*000* 
Altitude  | 

(1(0,000*)  I— 

Heading  f 

(360°)  l— 


(8)  OUTBOUND  PENETRA* 

7  ^*000') 

Vert/Rate  i 

(1(000  tpn)  I - * 


Heading 

(360°) 


Altitude 

(1300*) 

Heading 

(230°) 

Airspeed 
(170  knots) 


□ 

□ 

□ 
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APFEHBH  C 


Scoring  Procedures 


The  following  scoring  procedures  were  observed  far  all 
experimental  runs*  The  numbers  correspond  to  the  scoring 
maneuvers  on  the  scoring  sheet* 


(1)  Take-off  and  Climb  to  1*0,000  Feet 

Master  Scoring  switch  on  "Man"  (Manual)* 

Push  "Start"  button  (begin  scoring)  at  5000  feet* 
Score  mach  at  *85* 

Score  heading  at  zero  degrees* 

Readout  error  scores* 

Reset  integrators* 

Master  Scoring  switch  on  "Man". 

Push  "Start"  button  (begin  scoring)  at  26,000  feet* 
Score  mach  at  *85* 

Score  heading  at  sero  degrees* 

Readout  error  scores* 

Reset  integrators* 


(2)  Level^off  at  1*0*000  Feet 

Master  Scoring  switch  on  "Auto"  (Automatic) 

Push  "Start"  button  (system  is  now  armed  to  begin  scoring 
automatically  when  vertical  rate  reaches  sero)  at  39,200  feet* 
Score  altitude  at  1*0,000  feet* 

Score  heading  at  zero  degrees. 

Readout  error  scores* 

Reset  integrators* 


(3)  180  Degree  level  Turn  to  the  Left 
Master  Scoring  switch  on  "Man”*  . 

Push  "Start"  button  (begin  scoring)  when  bank  reaches  30 

degrees*. 

Score  altitude  at  1*0,000  feet* 

Readout  error  score* 

Reset  integrators* 


•  t 


(ii)  180  Degree  Level  Turn  to  the  Right 
Master  Scoring  switch  oh  "Man". 

Push  "Start0  button  (begin  scoring)  when  bank  reaches  30 
degrees* 

Score  altitude  at  1*0,000  feet* 

Readout  error  score* 

Reset  integrators* 


($)  Straight  and  Level  Flight 

Master  Scoring  switch  on  "Man"* 

Start  timer  clock  when  finished  with  voice  instruction* 
Push  "Start"  button  (begin  scoring)  when  30  seconds  have 
elapsed* 

Score  altitude  at  1*0,000  feet* 

Score  heading  at  zero  degrees* 

Readout  error  scores* 

Reset  integrators* 


(6)  Fast  Rate  Let-down 

Master  Scoring  switch  on  "Man". 

Push  "Start"  button  (begin  scoring)  at  37*000  feet* 
Score  mach  at*  1*0* 

Score  heading  at  zero  degrees* 

Readout  error  scores* 

Reset  integrators* 


(7)  Level-off  at  20*000  Feet 

Master  Scoring  switch  on  "Auto"* 

Push  "Start"  button  at  20,800  feet  (system  now  armed  to 
begin  scoring  when  vertical  rate  reaches  zero)* 

Score  altitude  at  20,000  feet* 

Score  heading  at  zero  degrees* 

Rea'^out  error  scores* 

Reset  integrators* 


(8)  Outbound  Penetration 

Master  Scoring  switch  on  "Man"* 

Push.  "Start"  button  (begin  scoring)  at  18,000  feet* 
Score  vertical  rate  at  1*000  feet  per  minute* 

Score  heading  at  zero  degrees* 
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Readout  error  scores 
Reset  integrators* 


(9)  Penetration  Turn 

Master  Scoring  switch  on  "Man"* 

Record  altitude  when  bank  (turn)  is  commenced* 

Push  “Start"  button  (begin  scoring)  when  bank  reaches  30 
degrees* 

Score  vertical  rate  at  U000  feet  per  minute* 

Readout  error  score* 

Reset  integrators* 


(lo)  Level-off  at  2300  Feet. 

Master  Scoring  switch  on  "Auto"  * 

Push  “Start"  button  at  3100  feet  (system  now  aimed  to  begin 
scoring  automatically  when  vertical  rate  reaches  aero*) 
Score  «dtLtuie  at  2300  feet* 

Score  heading  at  230  dagrees 
Readout  error  scores* 

Reset  integrators. 


(11)  Low  Approach  at  1300  Feet 

Master  Scoring  switch  on  "Man"* 

Start  timer  dock  when  vertical  rate  reaches  zero  when 
within  200  feet  of  1300  feet  altitude* 

Turn  on  station  marker  light  at  end  of  30  seconds* 

Push  “Start"  button  (begin  scoring)  and- turn  off  station 
'  marker  light  at  end  of  5  seconds* 

Score  altitude  at  1300  feet* 

Score  heading  at  230  degrees* 

Score  airspeed  at  170  knots* 

Readout  error  scores* 

Reset  integrators* 


APPENDIX  D 


Cockpit  Check 


Prior  to  each  flight  in  the  YF-102  Link  flight  simulator, 
the  subject  was  given  a  thorough  coclqpit  check  covering  all 
the  controls |  switches)  and  instruments  that  would  be  used  by 
him  during  the  experimental  run.  After  the  subject  had  enter¬ 
ed  the  cockpit)  he  was  asked  to  make  himself  comfortable  by 
adjusting  the  rudder  pedals  and  the  seat*  The  following 
checklist  was  then  used  to  corplete  the  checks 


Throttle  Control 


1*  Normal  use. 

2*  Afterburner  operation. 

3*  Speed  brake  switch  and  operation. 
It*  Mike  button* 


Landing  Gear 

1*  Handle  operation. 
2*  indication. 


Instrument  Panel 

1*  Attitude  Director  Indicator.  (Operation  and 
interpretation  of  display)* 

2*  Horizontal  Situation  Indicator*  (Operation  and 
interpretation  of  display)* 

3*  Airspeed-Mach  Indicator* .  (Operation  and  inter¬ 
pretation  of  display)* 

It*  Altimeter-Rate  of  Climb  Indicator*  (Operation 
and  interpretation  of  display)* 

5*  Percent  RPM  indicator*  (Operation  and  interpre¬ 
tation  of  display)* 

6*  Station  marker  light* 

7*  Speed  brake  indicator* 

8*  Penetration  card. 


# 


Control  Stick 

1*  Sensitivity  of  control  action* 

2*  Trim  control  (pitch  trim  slow,  necessary  to  hold 
longer)* 

3*  Mike  button  (alternate)* 

It*  Pilot  assist  button  (caution  against  using)* 


Canopy  Operation 

1*  Switch  location  and  operation* 
2*  Panel  light  location* 


Aqy  Questions 


Headset  and  lip  Mike 

1«  Flight  Instructions  will  be  given  over  the 
intercom* 

2*  Put  headset  on  and  get  it  adjusted* 


Refer  to  Practice  Session  Instructions 


Praotioe  Session 


A  ten  minute  practice  session  was  given  to  each  subject 
before  each  flight  in  the  simulator*  The  following  instruc¬ 
tions  ware  read  to  the  subjects  vertabim*  At  times  it  was 
neoessary  to  supplement  the  instructions  with  additional  com¬ 
ments,  if  the  subject  had  difficulty  in  handling  the  trainer 
daring  the  take-off* 

1*  OK,  we  are  now  ready  for  a  practice  session*  I  will 
doss  the  canopy  and  instruct  you  through  a  take-off 
from  the  perch  here*  (Close  the  canopy,  making  sure 
the  canopy  rails  are  dear)* 

2*  The  engine  la  now  at  idle  RPM* 

3*  X  want  you  to  advance  the  throttle  full  forward*  As 
the  RPM  nears  10O£,  kick  in  the  afterburner  by  moving 
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the  throttle  outboard* 

It*  OK,  we’re  in  afterburner  operation j  when  the  airspeed 
reaches  1$0  knots,  begin  rotating  the  nose  to  about 
10  degrees  pitch  up*  Once  airborne,  as  indicated  by 
tbs  altimeter,  it  will  be  necessary  to  apply  forward 
stick  pressure  and  trim  to  keep  the  nose  from  shooting 
up  rather  abruptly* 

5>*  OK,  you're  airborne,  raise  the  landing  gear* 

6*  Keep  the  pitch  19  angle  at  5  degrees  or  les3  and  stay 
below  3000'  until  mach  *80  is  reached*  As  you  pass 
through  mach  *80  then  increase  the  pitch  up  angle  and 
set  up  a  climbing  mach  of  *85* 

7*  OK,  you*  re  passing  through  mach  *80,  increase  the 
pitch  angle  slightly  and  set  up  a  climbing  mach 
of  .8$. 

8*  You  will  now  have  10  minutes  to  practice  climbs, 
turns,  levsl  flight,  descents,  and  speed  brake 
operation* 

9*  Request  you  stay  below  20,000' . 

10*  It's  all  yours. 

At  this  point  the  time  was  noted  for  purposes  of  starting 
the  10  minute  practice  period*  During  the  practice  session, 
the  station  marker  light  was  turned  on  and  the  subject  was  asked 
to  signal  when  he  had  the  light  adjusted  to  a  desired  brightness* 
The  light  was  then  turned  off*  Just  prior  to  the  conpletion  of 
nine  minutes  practice,  the  subject  was  infozmed  that  there  was 
one  minute  remaining  in  the  practice  session  and  it  was  suggested 
that  he  start  down  toward  ground  level*  When  the  ten  minutes 
were  up,  the  simulator  was  put  in  the  "freeze"  position  and  the 
canopy  was  opened*  The  experimenter  then  put  the  simulator  back 
in  normal  operation  and  flew  it  to  ground  level*  The  subject 
was  asked  if  he  had  any  questions  about  tho  operation  of  the 
simulator  or  the  instruments.  After  answering  any  questions, 
the  experimenter  vent  through  the  following  checklist  to  in¬ 
sure  proper  and  identical  starting  points  for  each  flights 

1*  Ground  level  (zero  feet  altitude), 

2*  Zero  degrees  heading* 

3*  Idle  KPM. 

U.  Landing  gear  down* 


5*  Speed  brakes  in* 

6*  Pilot  assist  off* 

7*  Daqper  on  manual* 

8*  Any  questions* 

The  canopy  was  then  closed  and  the  experimenter  went  to  the 
experimenter's  control  panel  to  begin  the  flight  task  instruc¬ 
tions* 
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Table  22 

Mean  Heading  RMS  Errors 


Maneuver 

mower 

Experienced 

Standard  Vertical 

Non-Experienced 

Standard  Vertical 

All  Subjects 

Standard  Vertical 

la 

2.632 

3.707 

2.558 

2.903 

2.590 

7.251 

lb 

1.591 

1.71*2 

1.802 

1.712 

1.711 

1.725 

2 

1.897 

1.967 

1.883 

2.32ft 

1.889 

2.169 

5 

1.1487 

1.399 

1.253 

1.52v 

1.35ft 

1.1*72 

6 

1.091 

1.199 

1.207 

1.351 

1.157 

1.286 

7 

1.875 

1.698 

1.788 

2.023 

1.826 

1.882 

8 

1.31*7 

1.839 

1.590 

1.756 

1.1*85 

1.792 

10 

1.W7 

1.1*68 

1.231 

2.1*1*2 

1.31|2 

2.020 

11 

1.632 

2.381* 

1.1*62 

2.001 

1.536 

2.167 

Table  23 

Mean  Altitude  RMS  Errors 


Maneuver 

Niruber 

Experienced 

Standard  Vertical 

Non-Experienced 

Standard  Vertical 

All  Subjects 

Standard  Vertical 

2 

2.280 

3.621 

1.912 

1*«050 

2.072 

3.861* 

3 

1.171* 

2.679 

1.056 

2.21*5 

1.108 

2.1*33 

1* 

1.1*09 

2,1*9 

-V368 

2.926 

1.385 

2.715 

5 

•818 

2.535 

•it93 

1.915 

.631* 

2.181* 

7 

2.306 

1.713 

2.203 

1.766 

2.21*8 

1.71*3 

10 

1.336 

2.1*06 

.8c*l 

1.817 

1.067 

2.072 

11 

•1*29 

1.1*62 

.2*21* 

.951 

.1*26 

1.173 
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Table  21 


9 


Mean  Mach  KHS  Errors 


Maneuver 

Number 

Experienced 

Standard  Vertical 

Non-Experienced 

Standard  Vertical 

All  Subjects 

Standard  Vertical 

la 

iu903 

2.373 

lt.832 

2.898 

2i«863 

2.671 

lb 

2.51*7 

1.618 

2.390 

1.505 

2.1*58 

1.551* 

6 

1.213 

.970 

1.833 

.9324 

1.577 

.950 

Table  2$ 

Mean  Vertical  Kate  RMS  Errors 


Maneuver 

Number 

Experienced 

Standard  Vertical 

Non-Experienced 

Standard  Vertical 

All  Subjects 

Standard  Vertical 

8 

3.511 

U.306 

3.91*1 

3.897 

3.755 

U.071* 

9 

3.850 

3.500 

3.789 

3.1*29 

3.815 

3.1*60 

Table  26 

Mean  Airspeed  IMS  Errors 


Maneuver 

Experienced 

Non-Experienced 

All  Subjects 

Number 

Standard 

Vertical 

Standard 

Vertical 

Standard 

Vertical 

11 

1.290 

1.895 

1.638 

2.081* 

1.1*87 

2.002 

-57 
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